Sep 25 18:20:15 devstack cinder-volume[75327]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 18:20:15 devstack cinder-volume[75327]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 18:20:15 devstack cinder-volume[75327]: we strongly recommend against using it for new projects.
Sep 25 18:20:15 devstack cinder-volume[75327]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 18:20:15 devstack cinder-volume[75327]: framework.  For more detail see
Sep 25 18:20:15 devstack cinder-volume[75327]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 18:20:15 devstack cinder-volume[75327]:   import eventlet  # noqa
Sep 25 18:20:17 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:20:17 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:20:17 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:20:18 devstack cinder-volume[75327]: INFO dbcounter [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Registered counter for database cinder
Sep 25 18:20:19 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:20:19 devstack cinder-volume[75327]: DEBUG dbcounter [-] [75327] Writer thread running {{(pid=75327) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 18:20:19 devstack cinder-volume[75327]: INFO cinder.rpc [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 18:20:19 devstack cinder-volume[75327]: INFO cinder.rpc [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 18:20:19 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:20:19 devstack cinder-volume[75327]: INFO cinder.volume.manager [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Determined volume DB was empty at startup.
Sep 25 18:20:19 devstack cinder-volume[75327]: DEBUG cinder.volume.manager [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75327) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 18:20:19 devstack cinder-volume[75327]: INFO cinder.volume.manager [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 18:20:19 devstack cinder-volume[75327]: WARNING stevedore.named [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 18:20:19 devstack cinder-volume[75327]: WARNING castellan.key_manager [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:20:19 devstack cinder-volume[75327]: WARNING cinder.keymgr.conf_key_mgr [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:20:19 devstack cinder-volume[75327]: DEBUG cinder.volume.drivers.lvm [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75327) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 25 18:20:19 devstack cinder-volume[75327]: DEBUG oslo_concurrency.processutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75327) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_concurrency.processutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] CMD "cinder-rtstool verify" returned: 0 in 0.438s {{(pid=75327) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:20:20 devstack cinder-volume[75327]: INFO cinder.rpc [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 25 18:20:20 devstack cinder-volume[75327]: INFO cinder.rpc [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 25 18:20:20 devstack cinder-volume[75327]: WARNING stevedore.named [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 18:20:20 devstack cinder-volume[75327]: WARNING castellan.key_manager [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:20:20 devstack cinder-volume[75327]: INFO cinder.volume.manager [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_db.sqlalchemy.engines [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:20:20 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Starting 1 workers
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Started child 75517 {{(pid=75327) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Full set of CONF: {{(pid=75327) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] ******************************************************************************** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Configuration options gathered from: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] ================================================================================ {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] allow_availability_zone_fallback = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] allow_compression_on_image_upload = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75517]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] allowed_direct_url_schemes     = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] api_rate_limit                 = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] auth_strategy                  = keystone {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] az_cache_duration              = 3600 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_availability_zone      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_host                   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_name                   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_stats_polling_interval = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backup_api_class               = cinder.backup.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backup_name_template           = backup-%s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backup_use_same_host           = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backup_use_temp_snapshot       = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] chap_password                  = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] chap_username                  =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_internal_tenant_project_id = bc32c7f1f2204feeb977b678a5cc30d5 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_internal_tenant_user_id = b055d162e70641b09edb1253bea61e39 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cloned_volume_same_az          = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cluster                        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] compression_format             = gzip {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] compute_api_class              = cinder.compute.nova.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] config_dir                     = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] config_source                  = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] control_exchange               = openstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] debug                          = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] default_availability_zone      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] default_group_type             = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] default_volume_type            = lvmdriver-1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] disk_geometry                  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] driver_client_cert             = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] driver_client_cert_key         = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] driver_data_namespace          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] driver_ssl_cert_path           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] driver_ssl_cert_verify         = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] driver_use_ssl                 = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] enable_force_upload            = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] enable_new_services            = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] enable_unsupported_driver      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] enforce_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] filter_function                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_api_insecure            = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_api_servers             = ['http://192.168.122.123/image'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_api_ssl_compression     = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_ca_certificates_file    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_catalog_info            = image:glance:publicURL {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_certfile                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_keyfile                 = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_num_retries             = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance_request_timeout         = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] goodness_function              = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] graceful_shutdown_timeout      = 5 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] group_api_class                = cinder.group.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] host                           = devstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_compress_on_upload       = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_conversion_address_space_limit = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_conversion_cpu_limit     = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_conversion_disable       = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_introspection_address_space_limit = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_introspection_cpu_limit  = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_upload_use_cinder_backend = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_upload_use_internal_tenant = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_volume_cache_enabled     = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_volume_cache_max_count   = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] image_volume_cache_max_size_gb = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] init_host_max_objects_retrieval = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] iscsi_target_flags             =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] iscsi_write_cache              = on {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] iser_helper                    = tgtadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] iser_ip_address                = 192.168.122.123 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] iser_port                      = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_color                      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_config_append              = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_dir                        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_file                       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_options                    = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_rotate_interval            = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_rotate_interval_type       = days {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] log_rotation_type              = none {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] max_age                        = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] max_logfile_count              = 30 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] max_logfile_size_mb            = 200 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] max_over_subscription_ratio    = 20.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] message_reap_interval          = 86400 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] message_ttl                    = 2592000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] migration_create_volume_timeout_secs = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] monkey_patch                   = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] monkey_patch_modules           = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] my_ip                          = 192.168.122.123 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] no_snapshot_gb_quota           = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] num_iser_scan_tries            = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] num_shell_tries                = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] num_volume_device_scan_tries   = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] nvmeof_conn_info_version       = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] nvmet_ns_id                    = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] nvmet_port_id                  = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_max_limit                = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_volume_ext_list          = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_volume_listen_port       = 8776 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_volume_use_ssl           = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] osapi_volume_workers           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] per_volume_size_limit          = -1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] periodic_fuzzy_delay           = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] periodic_interval              = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] public_endpoint                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] publish_errors                 = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_backup_gigabytes         = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_backups                  = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_gigabytes                = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_groups                   = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_snapshots                = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] quota_volumes                  = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] rate_limit_burst               = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] rate_limit_except_level        = CRITICAL {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] rate_limit_interval            = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] reinit_driver_count            = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] replication_device             = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] report_discard_supported       = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] report_interval                = 120 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] reservation_clean_interval     = 86400 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] reservation_expire             = 86400 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] reserved_image_namespaces      = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] reserved_percentage            = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] rpc_response_timeout           = 120 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] run_external_periodic_tasks    = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] scst_target_driver             = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] scst_target_iqn_name           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_down_time              = 720 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] shell_completion               = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] snapshot_name_template         = snapshot-%s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] snapshot_same_host             = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] split_loggers                  = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] state_path                     = /opt/stack/data/cinder {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] storage_availability_zone      = nova {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] storage_protocol               = iSCSI {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] syslog_log_facility            = LOG_USER {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] target_helper                  = lioadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] target_ip_address              = 192.168.122.123 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] target_port                    = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] target_protocol                = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] target_secondary_ip_addresses  = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] trace_flags                    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] transport_url                  = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] until_refresh                  = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_chap_auth                  = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_default_quota_class        = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_journal                    = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_json                       = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_multipath_for_image_xfer   = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_stderr                     = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] use_syslog                     = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] verify_glance_signatures       = enabled {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_api_class               = cinder.volume.api.API {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_backend_name            = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_clear                   = zero {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_clear_ionice            = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_clear_size              = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_copy_bps_limit          = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_dd_blocksize            = 1M {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_name_template           = volume-%s {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_service_inithost_offload = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volume_usage_audit_period      = month {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] zoning_mode                    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_concurrency.disable_process_locking = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.auth_section = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.auth_type   = password {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.auth_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.cache       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.certfile    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.include_service_catalog = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.insecure    = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.interface   = public {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.keyfile     = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcache_username = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.region_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.service_type = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.123/identity {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.backend                  = dogpile.cache.null {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.backend_argument         = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.backend_expiration_time  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.config_prefix            = cache.oslo {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.debug_cache_backend      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.enable_retry_client      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.enable_socket_keepalive  = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.enabled                  = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.expiration_time          = 600 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.hashclient_retry_attempts = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_dead_retry      = 300 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_sasl_enabled    = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.password                 = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.proxies                  = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.redis_db                 = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75517]: INFO cinder.volume.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.redis_server             = localhost:6379 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.retry_attempts           = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.retry_delay              = 0.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.socket_keepalive_count   = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.socket_keepalive_idle    = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.socket_keepalive_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.socket_timeout           = 1.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.tls_allowed_ciphers      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.tls_cafile               = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.tls_certfile             = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.tls_enabled              = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.tls_keyfile              = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cache.username                 = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] coordination.backend_url       = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.asyncio_connection    = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.asyncio_slave_connection = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.backend               = sqlalchemy {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.connection            = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.connection_debug      = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.connection_parameters =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.connection_recycle_time = 3600 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.connection_trace      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.db_inc_retry_interval = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.db_max_retries        = 20 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.db_max_retry_interval = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.db_retry_interval     = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.max_overflow          = 50 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.max_pool_size         = 5 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.max_retries           = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.mysql_wsrep_sync_wait = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.pool_timeout          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.retry_interval        = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.slave_connection      = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.sqlite_synchronous    = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.synchronous_reader    = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] database.use_db_reconnect      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_tracing.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.connection_string     = messaging:// {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.enabled               = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.es_doc_type           = notification {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.es_scroll_size        = 10000 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.es_scroll_time        = 2m {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.filter_error_trace    = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.hmac_keys             = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.sentinel_service_name = mymaster {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.socket_timeout        = 0.1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.trace_requests        = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler.trace_sqlalchemy      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler_jaeger.process_tags   = {} {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler_jaeger.service_name_prefix = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] profiler_otlp.service_name_prefix = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.enforce_new_defaults = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.policy_default_rule = default {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.group          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.helper_command = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] privsep_osbrick.user           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.group         = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.helper_command = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] cinder_sys_admin.user          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.auth_section      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.auth_type         = password {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.cafile            = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.certfile          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.collect_timing    = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.insecure          = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.keyfile           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.send_service_user_token = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.split_loggers     = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.timeout           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.tls_ciphers       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] service_user.tls_min_version   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.auth_section            = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.auth_type               = password {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.certfile                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.collect_timing          = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.insecure                = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.keyfile                 = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.region_name             = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.split_loggers           = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.timeout                 = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.tls_ciphers             = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] glance.tls_min_version         = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.backend_availability_zone = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.chap_password = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.chap_username =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.disk_geometry = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.driver_client_cert = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.driver_client_cert_key = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.driver_data_namespace = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.driver_use_ssl = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.extra_capabilities = {} {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.filter_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.goodness_function = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.iscsi_target_flags =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.iscsi_write_cache = on {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.iser_helper   = tgtadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.iser_ip_address = 192.168.122.123 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.iser_port     = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.lvm_share_target = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.lvm_type      = auto {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.num_shell_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.replication_device = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.report_discard_supported = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.reserved_percentage = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.target_helper = tgtadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.target_ip_address = 192.168.122.123 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.target_port   = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.target_protocol = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.trace_flags   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.unique_fqdn_network = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.use_chap_auth = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_backend_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_clear  = zero {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_clear_ionice = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_clear_size = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_reports.file_event_handler = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_reports.log_dir           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.backend_host       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.chap_password      = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.chap_username      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.disk_geometry      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.driver_client_cert = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.extra_capabilities = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.filter_function    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.goodness_function  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.iser_helper        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.iser_ip_address    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.iser_port          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.lvm_share_target   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.lvm_type           = auto {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.num_shell_tries    = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.replication_device = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.report_discard_supported = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.reserved_percentage = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.scst_target_driver = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.storage_protocol   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.target_helper      = lioadm {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.target_ip_address  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.target_port        = 3260 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.trace_flags        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.use_chap_auth      = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_clear       = zero {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_clear_size  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] lvmdriver-1.volumes_dir        = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_notifications.driver = [] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_notifications.retry = -1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] key_manager.fixed_key          = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.barbican_api_version  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.barbican_endpoint     = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.barbican_endpoint_type = public {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.barbican_region_name  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.cafile                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.certfile              = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.collect_timing        = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.insecure              = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.keyfile               = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.number_of_retries     = 60 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.retry_delay           = 1 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.send_service_user_token = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.split_loggers         = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.timeout               = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.tls_ciphers           = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.tls_min_version       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.verify_ssl            = True {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican.verify_ssl_path       = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.auth_section = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.auth_type = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.cafile   = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.certfile = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.collect_timing = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.insecure = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.keyfile  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.split_loggers = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.timeout  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.tls_ciphers = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] barbican_service_user.tls_min_version = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.approle_role_id          = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.approle_secret_id        = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.auth_method              = approle {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.auth_path                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.kv_mountpoint            = secret {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.kv_path                  = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.kv_version               = 2 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.namespace                = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.root_token_id            = **** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.ssl_ca_crt_file          = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.timeout                  = 60.0 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.token_file               = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.token_role               = None {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.use_ssl                  = False {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:20:20 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] ******************************************************************************** {{(pid=75327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack sudo[75530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 25 18:20:20 devstack sudo[75530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:20 devstack sudo[75530]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack sudo[75650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:20 devstack sudo[75650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:20 devstack sudo[75650]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.262s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:20:20 devstack cinder-volume[75517]: INFO cinder.brick.local_dev.lvm [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:20 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:21 devstack sudo[75748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:20:21 devstack sudo[75748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:21 devstack sudo[75748]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG cinder.brick.local_dev.lvm [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75517) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:21 devstack sudo[75831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:21 devstack sudo[75831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:21 devstack sudo[75831]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.471s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:21 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:21 devstack sudo[76005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:21 devstack sudo[76005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:22 devstack sudo[76005]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:22 devstack sudo[76125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 25 18:20:22 devstack sudo[76125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:22 devstack sudo[76125]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.257s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:22 devstack sudo[76128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:20:22 devstack sudo[76128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:22 devstack sudo[76128]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:22 devstack sudo[76211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:20:22 devstack sudo[76211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:22 devstack sudo[76211]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:22 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:22 devstack sudo[76214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:22 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:23 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:23 devstack sudo[76246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:23 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:23 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:23 devstack sudo[76307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:23 devstack sudo[76307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:23 devstack sudo[76307]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:23 devstack cinder-volume[75517]: INFO cinder.volume.drivers.lvm [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:23 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:23 devstack sudo[76311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:23 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:24 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:24 devstack sudo[76320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:20:24 devstack sudo[76320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:24 devstack sudo[76320]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:24 devstack sudo[76323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:24 devstack sudo[76323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:24 devstack sudo[76323]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:24 devstack sudo[76326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:24 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:24 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:24 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:24 devstack sudo[76330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:24 devstack sudo[76330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:25 devstack sudo[76330]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:25 devstack cinder-volume[75517]: INFO cinder.volume.driver [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG cinder.volume.driver [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_db.sqlalchemy.engines [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG dbcounter [-] [75517] Writer thread running {{(pid=75517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG cinder.db.api [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Building query based on filter {{(pid=75517) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG cinder.image.image_utils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 18:20:25 devstack cinder-volume[75517]: INFO cinder.keymgr.migration [None req-e70f34cf-0f98-48df-95dc-cc08e40b5eb4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:25 devstack sudo[76333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:20:25 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:25 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:25 devstack sudo[76338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:25 devstack sudo[76338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:25 devstack sudo[76338]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:25 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:25 devstack sudo[76341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:25 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:26 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:26 devstack sudo[76344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:26 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:26 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG cinder.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Notifying Schedulers of capabilities ... {{(pid=75517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:20:26 devstack cinder-volume[75517]: INFO cinder.volume.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Driver initialization completed successfully.
Sep 25 18:20:26 devstack cinder-volume[75517]: INFO cinder.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Initiating service 2 cleanup
Sep 25 18:20:26 devstack cinder-volume[75517]: INFO cinder.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Service 2 cleanup completed.
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG cinder.service [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Creating RPC server for service cinder-volume {{(pid=75517) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG cinder.service [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75517) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 18:20:26 devstack cinder-volume[75517]: INFO cinder.volume.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:26 devstack sudo[76347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:20:26 devstack sudo[76347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:26 devstack sudo[76347]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:26 devstack sudo[76352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:26 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:27 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:27 devstack sudo[76358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:20:27 devstack sudo[76358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:27 devstack sudo[76358]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:20:27 devstack sudo[76361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:20:27 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:20:27 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root
Sep 25 18:20:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:20:27 devstack cinder-volume[75517]: INFO cinder.volume.manager [None req-d69e98af-644f-4066-bda3-53cf37b81288 None None] Driver post RPC initialization completed successfully.
Sep 25 18:20:30 devstack cinder-volume[75327]: DEBUG dbcounter [-] [75327] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75327) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:20:37 devstack cinder-volume[75517]: DEBUG dbcounter [-] [75517] Writing DB stats cinder:SELECT=4 {{(pid=75517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:20:37 devstack cinder-volume[75517]: DEBUG dbcounter [-] [75517] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:21:26 devstack cinder-volume[75517]: DEBUG oslo_service.periodic_task [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:21:26 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:21:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:21:26 devstack sudo[78369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:21:26 devstack sudo[78369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:21:26 devstack sudo[78369]: pam_unix(sudo:session): session closed for user root
Sep 25 18:21:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:21:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:21:26 devstack sudo[78372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:21:26 devstack sudo[78372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:21:27 devstack sudo[78372]: pam_unix(sudo:session): session closed for user root
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:21:27 devstack sudo[78375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:21:27 devstack sudo[78375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:21:27 devstack sudo[78375]: pam_unix(sudo:session): session closed for user root
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:21:27 devstack sudo[78378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:21:27 devstack sudo[78378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:21:27 devstack sudo[78378]: pam_unix(sudo:session): session closed for user root
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG cinder.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Notifying Schedulers of capabilities ... {{(pid=75517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG oslo_service.periodic_task [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running periodic task VolumeManager._thread_info {{(pid=75517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG cinder.volume.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] thread count: 6 {{(pid=75517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:21:27 devstack cinder-volume[75517]: DEBUG cinder.volume.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] thread info: [<_MainThread(MainThread, started 134427748839552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134427633823040)>, <Thread(Thread-3 (stat_writer), started daemon 134427634099840)>, <Thread(Rabbit-heartbeat, started daemon 134427633405952)>, <Thread(Thread-5 (_runner), started daemon 134427633455168)>, <Thread(Thread-7 (_runner), started daemon 134427631526720)>] {{(pid=75517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:22:26 devstack cinder-volume[75517]: DEBUG oslo_service.periodic_task [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:22:26 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:22:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:22:26 devstack sudo[81660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:22:26 devstack sudo[81660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:22:26 devstack sudo[81660]: pam_unix(sudo:session): session closed for user root
Sep 25 18:22:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:22:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:22:26 devstack sudo[81671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:22:26 devstack sudo[81671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:22:27 devstack sudo[81671]: pam_unix(sudo:session): session closed for user root
Sep 25 18:22:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:22:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:22:27 devstack sudo[81674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:22:27 devstack sudo[81674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:22:27 devstack sudo[81674]: pam_unix(sudo:session): session closed for user root
Sep 25 18:22:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:22:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:22:27 devstack sudo[81684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:22:27 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:22:27 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root
Sep 25 18:22:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:22:27 devstack cinder-volume[75517]: DEBUG cinder.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Notifying Schedulers of capabilities ... {{(pid=75517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:22:37 devstack cinder-volume[75517]: DEBUG dbcounter [-] [75517] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:23:26 devstack cinder-volume[75517]: DEBUG oslo_service.periodic_task [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:23:26 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:23:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:23:26 devstack sudo[83683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:23:26 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:23:26 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root
Sep 25 18:23:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:23:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:23:26 devstack sudo[83697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:23:26 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:23:27 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:23:27 devstack sudo[83708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:23:27 devstack sudo[83708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:23:27 devstack sudo[83708]: pam_unix(sudo:session): session closed for user root
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:23:27 devstack sudo[83722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:23:27 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:23:27 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG cinder.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Notifying Schedulers of capabilities ... {{(pid=75517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG oslo_service.periodic_task [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running periodic task VolumeManager._thread_info {{(pid=75517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG cinder.volume.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] thread count: 6 {{(pid=75517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:23:27 devstack cinder-volume[75517]: DEBUG cinder.volume.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] thread info: [<_MainThread(MainThread, started 134427748839552)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134427633823040)>, <Thread(Thread-3 (stat_writer), started daemon 134427634099840)>, <Thread(Rabbit-heartbeat, started daemon 134427633405952)>, <Thread(Thread-5 (_runner), started daemon 134427633455168)>, <Thread(Thread-7 (_runner), started daemon 134427631526720)>] {{(pid=75517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:24:26 devstack cinder-volume[75517]: DEBUG oslo_service.periodic_task [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:24:26 devstack cinder-volume[75517]: DEBUG cinder.volume.drivers.lvm [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Updating volume stats {{(pid=75517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 25 18:24:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:26 devstack sudo[84996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 25 18:24:26 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:26 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:26 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:26 devstack sudo[85001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:24:26 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:27 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:27 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 25 18:24:27 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:27 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:27 devstack sudo[85010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 25 18:24:27 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:27 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:27 devstack cinder-volume[75517]: DEBUG oslo_concurrency.processutils [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:27 devstack cinder-volume[75517]: DEBUG cinder.manager [None req-7b5e1d0f-a5d1-4cec-8c68-f4f0cc2a0bd7 None None] Notifying Schedulers of capabilities ... {{(pid=75517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:24:37 devstack cinder-volume[75517]: DEBUG dbcounter [-] [75517] Writing DB stats cinder:SELECT=1 {{(pid=75517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:24:37 devstack cinder-volume[75517]: DEBUG dbcounter [-] [75517] Writing DB stats cinder:UPDATE=1 {{(pid=75517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:24:45 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Caught SIGTERM, stopping children
Sep 25 18:24:45 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Acquiring lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:24:45 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Acquired lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:24:45 devstack cinder-volume[75327]: DEBUG oslo_concurrency.lockutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Releasing lock "singleton_lock" {{(pid=75327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:24:45 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Stop services. {{(pid=75327) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 18:24:45 devstack cinder-volume[75327]: DEBUG oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Killing children. {{(pid=75327) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 18:24:45 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Waiting on 1 children to exit
Sep 25 18:24:46 devstack cinder-volume[75517]: DEBUG oslo_concurrency.lockutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Acquiring lock "singleton_lock" {{(pid=75517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:24:46 devstack cinder-volume[75517]: DEBUG oslo_concurrency.lockutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Acquired lock "singleton_lock" {{(pid=75517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:24:46 devstack cinder-volume[75517]: DEBUG oslo_concurrency.lockutils [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Releasing lock "singleton_lock" {{(pid=75517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:24:46 devstack cinder-volume[75517]: WARNING amqp [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 18:24:46 devstack cinder-volume[75517]: WARNING amqp [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 18:24:46 devstack cinder-volume[75327]: INFO oslo_service.backend._eventlet.service [None req-894026d1-8ee0-44bd-9774-944b7d5f876b None None] Child 75517 exited with status 0
Sep 25 18:24:46 devstack cinder-volume[85508]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 18:24:46 devstack cinder-volume[85508]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 18:24:46 devstack cinder-volume[85508]: we strongly recommend against using it for new projects.
Sep 25 18:24:46 devstack cinder-volume[85508]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 18:24:46 devstack cinder-volume[85508]: framework.  For more detail see
Sep 25 18:24:46 devstack cinder-volume[85508]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 18:24:46 devstack cinder-volume[85508]:   import eventlet  # noqa
Sep 25 18:24:49 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:24:49 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:24:49 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:24:49 devstack cinder-volume[85508]: INFO dbcounter [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Registered counter for database cinder
Sep 25 18:24:49 devstack cinder-volume[85508]: DEBUG oslo_db.sqlalchemy.engines [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG dbcounter [-] [85508] Writer thread running {{(pid=85508) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 18:24:50 devstack cinder-volume[85508]: INFO cinder.rpc [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 18:24:50 devstack cinder-volume[85508]: INFO cinder.rpc [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_db.sqlalchemy.engines [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:24:50 devstack cinder-volume[85508]: INFO cinder.volume.manager [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Determined volume DB was empty at startup.
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG cinder.volume.manager [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85508) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 18:24:50 devstack cinder-volume[85508]: INFO cinder.volume.manager [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 25 18:24:50 devstack cinder-volume[85508]: WARNING stevedore.named [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 18:24:50 devstack cinder-volume[85508]: WARNING castellan.key_manager [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:24:50 devstack cinder-volume[85508]: WARNING cinder.keymgr.conf_key_mgr [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:24:50 devstack cinder-volume[85508]: INFO cinder.volume.manager [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_db.sqlalchemy.engines [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85508) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:24:50 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Starting 1 workers
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Started child 85724 {{(pid=85508) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Full set of CONF: {{(pid=85508) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] ******************************************************************************** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Configuration options gathered from: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] ================================================================================ {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] allow_availability_zone_fallback = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] allow_compression_on_image_upload = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] allowed_direct_url_schemes     = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] api_rate_limit                 = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] auth_strategy                  = keystone {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_availability_zone      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_host                   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_name                   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_stats_polling_interval = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backup_api_class               = cinder.backup.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backup_name_template           = backup-%s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backup_use_same_host           = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backup_use_temp_snapshot       = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] chap_password                  = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] chap_username                  =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_internal_tenant_project_id = bc32c7f1f2204feeb977b678a5cc30d5 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_internal_tenant_user_id = b055d162e70641b09edb1253bea61e39 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85724]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cluster                        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] compression_format             = gzip {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] compute_api_class              = cinder.compute.nova.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] config_dir                     = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] config_source                  = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] control_exchange               = openstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] debug                          = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] default_availability_zone      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] default_group_type             = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] default_volume_type            = QuobyteHD {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] disk_geometry                  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] driver_client_cert             = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] driver_client_cert_key         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] driver_data_namespace          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] driver_ssl_cert_path           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] driver_ssl_cert_verify         = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] driver_use_ssl                 = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] enable_new_services            = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] enable_unsupported_driver      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] enabled_backends               = ['QuobyteHD'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] enforce_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] filter_function                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_api_insecure            = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_api_servers             = ['http://192.168.122.123/image'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_api_ssl_compression     = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_ca_certificates_file    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_catalog_info            = image:glance:publicURL {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_certfile                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_keyfile                 = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_num_retries             = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance_request_timeout         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] goodness_function              = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] graceful_shutdown_timeout      = 5 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] group_api_class                = cinder.group.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] host                           = devstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_compress_on_upload       = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_conversion_address_space_limit = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_conversion_cpu_limit     = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_conversion_disable       = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_introspection_address_space_limit = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_introspection_cpu_limit  = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_upload_use_cinder_backend = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_upload_use_internal_tenant = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_volume_cache_enabled     = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_volume_cache_max_count   = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] image_volume_cache_max_size_gb = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] init_host_max_objects_retrieval = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] instance_format                = [instance: %(uuid)s]  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] iscsi_target_flags             =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] iscsi_write_cache              = on {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] iser_helper                    = tgtadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] iser_ip_address                = 192.168.122.123 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] iser_port                      = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_color                      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_config_append              = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_dir                        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_file                       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_options                    = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_rotate_interval            = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_rotate_interval_type       = days {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] log_rotation_type              = none {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] max_age                        = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] max_logfile_count              = 30 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] max_logfile_size_mb            = 200 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] max_over_subscription_ratio    = 20.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] message_reap_interval          = 86400 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] message_ttl                    = 2592000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] migration_create_volume_timeout_secs = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] monkey_patch                   = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] monkey_patch_modules           = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] my_ip                          = 192.168.122.123 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] no_snapshot_gb_quota           = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] num_iser_scan_tries            = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] num_shell_tries                = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] num_volume_device_scan_tries   = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] nvmeof_conn_info_version       = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] nvmet_ns_id                    = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] nvmet_port_id                  = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_max_limit                = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_volume_ext_list          = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_volume_listen_port       = 8776 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_volume_use_ssl           = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] osapi_volume_workers           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] per_volume_size_limit          = -1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] periodic_fuzzy_delay           = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] periodic_interval              = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] public_endpoint                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] publish_errors                 = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_backup_gigabytes         = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_backups                  = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_gigabytes                = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_groups                   = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_snapshots                = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] quota_volumes                  = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] rate_limit_burst               = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] rate_limit_except_level        = CRITICAL {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] rate_limit_interval            = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.remotefs [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85724) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] reinit_driver_count            = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] replication_device             = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] report_discard_supported       = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] report_interval                = 120 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] reservation_clean_interval     = 86400 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] reservation_expire             = 86400 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] reserved_image_namespaces      = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] reserved_percentage            = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] rpc_response_timeout           = 120 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] run_external_periodic_tasks    = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] scst_target_driver             = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] scst_target_iqn_name           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_down_time              = 720 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] shell_completion               = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] snapshot_name_template         = snapshot-%s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] split_loggers                  = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] state_path                     = /opt/stack/data/cinder {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] storage_availability_zone      = nova {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] storage_protocol               = iSCSI {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] syslog_log_facility            = LOG_USER {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] target_helper                  = lioadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] target_ip_address              = 192.168.122.123 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] target_port                    = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] target_protocol                = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] target_secondary_ip_addresses  = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] trace_flags                    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] transport_url                  = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] until_refresh                  = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_chap_auth                  = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_default_quota_class        = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_journal                    = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_json                       = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_multipath_for_image_xfer   = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_stderr                     = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] use_syslog                     = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] verify_glance_signatures       = enabled {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_api_class               = cinder.volume.api.API {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_backend_name            = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_clear                   = zero {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_clear_ionice            = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_clear_size              = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_copy_bps_limit          = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_dd_blocksize            = 1M {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_name_template           = volume-%s {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_service_inithost_offload = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volume_usage_audit_period      = month {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] zoning_mode                    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_concurrency.disable_process_locking = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.auth_section = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.auth_type   = password {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.auth_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.cache       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.certfile    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.include_service_catalog = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.insecure    = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.interface   = public {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.keyfile     = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcache_username = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.region_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.service_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.123/identity {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.backend                  = dogpile.cache.null {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.backend_argument         = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.backend_expiration_time  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.config_prefix            = cache.oslo {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.debug_cache_backend      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.enable_retry_client      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.enable_socket_keepalive  = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.enabled                  = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.expiration_time          = 600 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.hashclient_retry_attempts = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_dead_retry      = 300 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_pool_maxsize    = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_sasl_enabled    = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.password                 = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.proxies                  = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.redis_db                 = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.redis_server             = localhost:6379 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.retry_attempts           = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.retry_delay              = 0.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.socket_keepalive_count   = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.socket_keepalive_idle    = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.socket_keepalive_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.socket_timeout           = 1.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.tls_allowed_ciphers      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.tls_cafile               = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.tls_certfile             = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.tls_enabled              = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.tls_keyfile              = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cache.username                 = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] coordination.backend_url       = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.asyncio_connection    = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.asyncio_slave_connection = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.backend               = sqlalchemy {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.connection            = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.connection_debug      = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.connection_parameters =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.connection_recycle_time = 3600 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.connection_trace      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.db_inc_retry_interval = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.db_max_retries        = 20 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.db_max_retry_interval = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.db_retry_interval     = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.max_overflow          = 50 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.max_pool_size         = 5 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.max_retries           = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.mysql_wsrep_sync_wait = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.pool_timeout          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.retry_interval        = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.slave_connection      = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.sqlite_synchronous    = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.synchronous_reader    = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] database.use_db_reconnect      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_tracing.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.connection_string     = messaging:// {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.enabled               = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.es_doc_type           = notification {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.es_scroll_size        = 10000 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.es_scroll_time        = 2m {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.filter_error_trace    = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.hmac_keys             = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.sentinel_service_name = mymaster {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.socket_timeout        = 0.1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.trace_requests        = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler.trace_sqlalchemy      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler_jaeger.process_tags   = {} {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler_jaeger.service_name_prefix = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] profiler_otlp.service_name_prefix = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.enforce_new_defaults = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.policy_default_rule = default {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.policy_file        = policy.yaml {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.group          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.helper_command = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] privsep_osbrick.user           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.group         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.helper_command = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] cinder_sys_admin.user          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.auth_section      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.auth_type         = password {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.cafile            = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85724) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.certfile          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.collect_timing    = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.insecure          = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.keyfile           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.send_service_user_token = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.split_loggers     = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.timeout           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.tls_ciphers       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] service_user.tls_min_version   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.auth_section            = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.auth_type               = password {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.certfile                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.collect_timing          = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.insecure                = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.keyfile                 = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.region_name             = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85724]: WARNING cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 18:24:50 devstack cinder-volume[85724]: WARNING cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Running cmd (subprocess): mount.quobyte {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.split_loggers           = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.timeout                 = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.tls_ciphers             = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] glance.tls_min_version         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.backend_availability_zone = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.chap_password = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.chap_username =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.disk_geometry = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.driver_client_cert = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.driver_client_cert_key = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.driver_data_namespace = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.driver_use_ssl = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.extra_capabilities = {} {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.filter_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.goodness_function = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.iscsi_target_flags =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.iscsi_write_cache = on {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.iser_helper   = tgtadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.iser_ip_address = 192.168.122.123 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.iser_port     = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_host      =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_login     = admin {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_mount_options = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_password  = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_private_key =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_share_path =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.num_shell_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.quobyte_volume_url = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.replication_device = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.report_discard_supported = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.reserved_percentage = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.target_helper = tgtadm {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.target_ip_address = 192.168.122.123 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.target_port   = 3260 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.target_protocol = iscsi {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.trace_flags   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.unique_fqdn_network = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.use_chap_auth = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_backend_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_clear  = zero {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_clear_ionice = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_clear_size = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_reports.file_event_handler = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_reports.log_dir           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.backend_availability_zone = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.backend_host         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.chap_password        = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.chap_username        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.chiscsi_conf         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.disk_geometry        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.driver_client_cert   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.driver_data_namespace = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.driver_use_ssl       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.extra_capabilities   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.filter_function      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.goodness_function    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.iser_helper          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.iser_ip_address      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.iser_port            = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.iser_target_prefix   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_host             = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_login            = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_mount_options    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_password         = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_private_key      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_share_path       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_ssh_port         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.num_shell_tries      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.nvmet_port_id        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.replication_device   = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.report_discard_supported = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.reserved_percentage  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.scst_target_driver   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.storage_protocol     = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.target_helper        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.target_ip_address    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.target_port          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.target_prefix        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.target_protocol      = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.trace_flags          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.use_chap_auth        = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_clear         = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_clear_size    = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] QuobyteHD.volumes_dir          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl      = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_notifications.driver = [] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_notifications.retry = -1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] key_manager.fixed_key          = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.barbican_api_version  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.barbican_endpoint     = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.barbican_endpoint_type = public {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.barbican_region_name  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.cafile                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.certfile              = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.collect_timing        = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.insecure              = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.keyfile               = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.number_of_retries     = 60 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.retry_delay           = 1 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.send_service_user_token = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.split_loggers         = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.timeout               = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.tls_ciphers           = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.tls_min_version       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack quobyte-client[85729]: Reading configuration file: /etc/quobyte/client.cfg
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.verify_ssl            = True {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican.verify_ssl_path       = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.auth_section = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.auth_type = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.cafile   = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.certfile = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.collect_timing = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack quobyte-client[85729]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.insecure = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.keyfile  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.split_loggers = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.timeout  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.tls_ciphers = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] barbican_service_user.tls_min_version = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.approle_role_id          = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.approle_secret_id        = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.auth_method              = approle {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.auth_path                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.kv_mountpoint            = secret {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.kv_path                  = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.kv_version               = 2 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.namespace                = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.root_token_id            = **** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.ssl_ca_crt_file          = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.timeout                  = 60.0 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.token_file               = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.token_role               = None {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.use_ssl                  = False {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:24:50 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] ******************************************************************************** {{(pid=85508) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=85724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:24:50 devstack cinder-volume[85724]: INFO cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 ...
Sep 25 18:24:50 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 -c /etc/quobyte/client-cinder.cfg {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:50 devstack sudo[85730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 -c /etc/quobyte/client-cinder.cfg
Sep 25 18:24:50 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:51 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.406s {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:51 devstack cinder-volume[85724]: INFO cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 succeeded
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=85724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.421s {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:51 devstack sudo[85829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:24:51 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:51 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.242s {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:51 devstack cinder-volume[85724]: INFO cinder.volume.driver [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.volume.driver [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2824325561523, 'free_capacity_gb': 1775.2824325561523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85724) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_db.sqlalchemy.engines [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG dbcounter [-] [85724] Writer thread running {{(pid=85724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.db.api [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Building query based on filter {{(pid=85724) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.image.image_utils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85724) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 18:24:51 devstack cinder-volume[85724]: INFO cinder.keymgr.migration [None req-487f4fbc-7ef3-46e0-a98c-1812bbc82618 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=85724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=85724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:51 devstack sudo[85833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:24:51 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:51 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.249s {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Notifying Schedulers of capabilities ... {{(pid=85724) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:24:51 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Driver initialization completed successfully.
Sep 25 18:24:51 devstack cinder-volume[85724]: INFO cinder.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Initiating service 3 cleanup
Sep 25 18:24:51 devstack cinder-volume[85724]: INFO cinder.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Service 3 cleanup completed.
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.service [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Creating RPC server for service cinder-volume {{(pid=85724) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 18:24:51 devstack cinder-volume[85724]: DEBUG cinder.service [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85724) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 18:24:52 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=85724) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG cinder.volume.drivers.quobyte [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=85724) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85724) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:24:52 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:24:52 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:24:52 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Sep 25 18:24:52 devstack cinder-volume[85724]: DEBUG oslo_concurrency.processutils [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.283s {{(pid=85724) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:24:52 devstack cinder-volume[85724]: INFO cinder.volume.manager [None req-660582f5-a25d-44e9-954d-ad5565f69266 None None] Driver post RPC initialization completed successfully.
Sep 25 18:24:56 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Caught SIGTERM, stopping children
Sep 25 18:24:56 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Acquiring lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:24:56 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Acquired lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:24:56 devstack cinder-volume[85508]: DEBUG oslo_concurrency.lockutils [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Releasing lock "singleton_lock" {{(pid=85508) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:24:56 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Stop services. {{(pid=85508) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 25 18:24:56 devstack cinder-volume[85508]: DEBUG oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Killing children. {{(pid=85508) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 25 18:24:56 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Waiting on 1 children to exit
Sep 25 18:24:56 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Acquiring lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:24:56 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Acquired lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:24:56 devstack cinder-volume[85724]: DEBUG oslo_concurrency.lockutils [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Releasing lock "singleton_lock" {{(pid=85724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:24:56 devstack cinder-volume[85724]: WARNING amqp [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 25 18:24:56 devstack cinder-volume[85508]: INFO oslo_service.backend._eventlet.service [None req-adbef6db-22a4-4a37-a442-cc17b41b8f0c None None] Child 85724 exited with status 0
Sep 25 18:24:56 devstack cinder-volume[86024]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 25 18:24:56 devstack cinder-volume[86024]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 18:24:56 devstack cinder-volume[86024]: we strongly recommend against using it for new projects.
Sep 25 18:24:56 devstack cinder-volume[86024]: If you are already using Eventlet, we recommend migrating to a different
Sep 25 18:24:56 devstack cinder-volume[86024]: framework.  For more detail see
Sep 25 18:24:56 devstack cinder-volume[86024]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 18:24:56 devstack cinder-volume[86024]:   import eventlet  # noqa
Sep 25 18:24:59 devstack cinder-volume[86024]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 25 18:24:59 devstack cinder-volume[86024]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 25 18:24:59 devstack cinder-volume[86024]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86024) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 25 18:25:00 devstack cinder-volume[86024]: INFO dbcounter [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Registered counter for database cinder
Sep 25 18:25:00 devstack cinder-volume[86024]: DEBUG oslo_db.sqlalchemy.engines [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG dbcounter [-] [86024] Writer thread running {{(pid=86024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 18:25:01 devstack cinder-volume[86024]: INFO cinder.rpc [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 25 18:25:01 devstack cinder-volume[86024]: INFO cinder.rpc [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_db.sqlalchemy.engines [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:25:01 devstack cinder-volume[86024]: INFO cinder.volume.manager [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Determined volume DB was empty at startup.
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG cinder.volume.manager [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86024) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 25 18:25:01 devstack cinder-volume[86024]: WARNING stevedore.named [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 25 18:25:01 devstack cinder-volume[86024]: WARNING castellan.key_manager [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:25:01 devstack cinder-volume[86024]: WARNING cinder.keymgr.conf_key_mgr [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 25 18:25:01 devstack cinder-volume[86024]: INFO cinder.volume.manager [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_db.sqlalchemy.engines [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:25:01 devstack cinder-volume[86024]: INFO oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Starting 1 workers
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Started child 86534 {{(pid=86024) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Full set of CONF: {{(pid=86024) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] ******************************************************************************** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] Configuration options gathered from: {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 25 18:25:01 devstack cinder-volume[86534]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] ================================================================================ {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] allow_availability_zone_fallback = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] allow_compression_on_image_upload = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] allowed_direct_url_schemes     = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] api_rate_limit                 = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] auth_strategy                  = keystone {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_availability_zone      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_host                   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_name                   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_stats_polling_interval = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backup_api_class               = cinder.backup.api.API {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backup_name_template           = backup-%s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backup_use_same_host           = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backup_use_temp_snapshot       = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] chap_password                  = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] chap_username                  =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_internal_tenant_project_id = bc32c7f1f2204feeb977b678a5cc30d5 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_internal_tenant_user_id = b055d162e70641b09edb1253bea61e39 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cluster                        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] compression_format             = gzip {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] config_dir                     = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 25 18:25:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86534) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] config_source                  = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] control_exchange               = openstack {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] debug                          = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] default_availability_zone      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] default_group_type             = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] default_volume_type            = QuobyteHD {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] disk_geometry                  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] driver_client_cert             = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] driver_client_cert_key         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] driver_data_namespace          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] driver_ssl_cert_path           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] driver_ssl_cert_verify         = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] driver_use_ssl                 = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] enable_new_services            = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] enable_unsupported_driver      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] enforce_multipath_for_image_xfer = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] filter_function                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_api_insecure            = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_api_servers             = ['http://192.168.122.123/image'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_api_ssl_compression     = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_ca_certificates_file    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_certfile                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_keyfile                 = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_num_retries             = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance_request_timeout         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] goodness_function              = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] graceful_shutdown_timeout      = 5 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] group_api_class                = cinder.group.api.API {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] host                           = devstack {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_compress_on_upload       = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_conversion_address_space_limit = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_conversion_cpu_limit     = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_conversion_disable       = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_introspection_address_space_limit = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_introspection_cpu_limit  = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_upload_use_cinder_backend = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_upload_use_internal_tenant = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_volume_cache_enabled     = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_volume_cache_max_count   = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] init_host_max_objects_retrieval = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] iscsi_target_flags             =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] iscsi_write_cache              = on {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] iser_helper                    = tgtadm {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] iser_ip_address                = 192.168.122.123 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:01 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] iser_port                      = 3260 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_color                      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_config_append              = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_dir                        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_file                       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_options                    = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_rotate_interval            = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_rotate_interval_type       = days {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] log_rotation_type              = none {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86534) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 25 18:25:02 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] max_age                        = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] max_logfile_count              = 30 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] max_logfile_size_mb            = 200 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] max_over_subscription_ratio    = 20.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] message_reap_interval          = 86400 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Running cmd (subprocess): mount.quobyte {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] message_ttl                    = 2592000 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] monkey_patch                   = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] monkey_patch_modules           = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] my_ip                          = 192.168.122.123 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] no_snapshot_gb_quota           = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] num_iser_scan_tries            = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] num_shell_tries                = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] num_volume_device_scan_tries   = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] nvmeof_conn_info_version       = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] nvmet_ns_id                    = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] nvmet_port_id                  = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_max_limit                = 1000 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_volume_ext_list          = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_volume_listen_port       = 8776 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_volume_use_ssl           = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] osapi_volume_workers           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] per_volume_size_limit          = -1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] periodic_fuzzy_delay           = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] periodic_interval              = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] public_endpoint                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] publish_errors                 = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_backup_gigabytes         = 1000 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_backups                  = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_gigabytes                = 1000 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_groups                   = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_snapshots                = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] quota_volumes                  = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] rate_limit_burst               = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] rate_limit_except_level        = CRITICAL {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] rate_limit_interval            = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] reinit_driver_count            = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] replication_device             = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] report_discard_supported       = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] report_interval                = 120 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] reservation_clean_interval     = 86400 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] reservation_expire             = 86400 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] reserved_image_namespaces      = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] reserved_percentage            = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] rpc_response_timeout           = 120 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] run_external_periodic_tasks    = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] scst_target_driver             = iscsi {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] scst_target_iqn_name           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_down_time              = 720 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] shell_completion               = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] snapshot_name_template         = snapshot-%s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] split_loggers                  = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] state_path                     = /opt/stack/data/cinder {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] storage_availability_zone      = nova {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] storage_protocol               = iSCSI {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] syslog_log_facility            = LOG_USER {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] target_helper                  = lioadm {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] target_ip_address              = 192.168.122.123 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] target_port                    = 3260 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] target_protocol                = iscsi {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] target_secondary_ip_addresses  = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] trace_flags                    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] transport_url                  = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] until_refresh                  = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_chap_auth                  = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_default_quota_class        = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_journal                    = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_json                       = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_multipath_for_image_xfer   = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_stderr                     = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] use_syslog                     = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] verify_glance_signatures       = enabled {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_api_class               = cinder.volume.api.API {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_backend_name            = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_clear                   = zero {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_clear_ionice            = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_clear_size              = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_copy_bps_limit          = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_dd_blocksize            = 1M {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_name_template           = volume-%s {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_service_inithost_offload = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volume_usage_audit_period      = month {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] zoning_mode                    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.auth_section = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.auth_type   = password {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.auth_version = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.cache       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.certfile    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.insecure    = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.interface   = public {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.keyfile     = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_password = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcache_username = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.region_name = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.service_type = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.123/identity {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.backend                  = dogpile.cache.null {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.backend_argument         = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.backend_expiration_time  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.config_prefix            = cache.oslo {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.debug_cache_backend      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] CMD "mount.quobyte" returned: 1 in 0.148s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.enable_retry_client      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.enable_socket_keepalive  = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.enabled                  = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.expiration_time          = 600 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_dead_retry      = 300 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_sasl_enabled    = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.password                 = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.proxies                  = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.redis_db                 = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.redis_server             = localhost:6379 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.retry_attempts           = 2 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.retry_delay              = 0.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.socket_keepalive_count   = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.socket_keepalive_idle    = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.socket_keepalive_interval = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.socket_timeout           = 1.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.tls_allowed_ciphers      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.tls_cafile               = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.tls_certfile             = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.tls_enabled              = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.tls_keyfile              = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cache.username                 = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] coordination.backend_url       = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.asyncio_connection    = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.asyncio_slave_connection = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.backend               = sqlalchemy {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.connection            = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.connection_debug      = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.connection_parameters =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.connection_recycle_time = 3600 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.connection_trace      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.db_inc_retry_interval = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.db_max_retries        = 20 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.db_max_retry_interval = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.db_retry_interval     = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.max_overflow          = 50 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.max_pool_size         = 5 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.max_retries           = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.pool_timeout          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.retry_interval        = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.slave_connection      = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.sqlite_synchronous    = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.synchronous_reader    = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] database.use_db_reconnect      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_tracing.insecure = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:25:02 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.connection_string     = messaging:// {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.enabled               = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.es_doc_type           = notification {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.es_scroll_size        = 10000 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.es_scroll_time        = 2m {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.filter_error_trace    = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.hmac_keys             = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.sentinel_service_name = mymaster {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.socket_timeout        = 0.1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.trace_requests        = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler.trace_sqlalchemy      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler_jaeger.process_tags   = {} {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] profiler_otlp.service_name_prefix = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.policy_default_rule = default {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.group          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.helper_command = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] privsep_osbrick.user           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.group         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.helper_command = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] cinder_sys_admin.user          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.auth_section      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.auth_type         = password {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.cafile            = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.certfile          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.collect_timing    = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.insecure          = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.keyfile           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.send_service_user_token = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.split_loggers     = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.timeout           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.tls_ciphers       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] service_user.tls_min_version   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.auth_section            = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.auth_type               = password {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.certfile                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.collect_timing          = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.insecure                = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.keyfile                 = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.region_name             = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.split_loggers           = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.timeout                 = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.tls_ciphers             = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] glance.tls_min_version         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.backend_availability_zone = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.chap_password = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.chap_username =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.disk_geometry = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.driver_client_cert = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.driver_data_namespace = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.driver_use_ssl = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.extra_capabilities = {} {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.filter_function = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.goodness_function = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.iscsi_target_flags =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.iser_ip_address = 192.168.122.123 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.iser_port     = 3260 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_host      =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_login     = admin {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_mount_options = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_password  = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_private_key =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_share_path =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.replication_device = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.report_discard_supported = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.target_helper = tgtadm {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.target_ip_address = 192.168.122.123 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.target_port   = 3260 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.target_protocol = iscsi {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.trace_flags   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.use_chap_auth = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_backend_name = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_clear  = zero {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_reports.file_event_handler = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_reports.log_dir           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.backend_host         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.chap_password        = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.chap_username        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.disk_geometry        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.driver_client_cert   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.extra_capabilities   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.filter_function      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.goodness_function    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.iser_helper          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.iser_ip_address      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.iser_port            = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_host             = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_login            = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_mount_options    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_password         = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_private_key      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_share_path       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.num_shell_tries      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.replication_device   = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.report_discard_supported = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.reserved_percentage  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.scst_target_driver   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.storage_protocol     = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.target_helper        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.target_ip_address    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.target_port          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.target_prefix        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.target_protocol      = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.trace_flags          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.use_chap_auth        = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_clear         = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_clear_size    = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] QuobyteHD.volumes_dir          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_notifications.driver = [] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] key_manager.fixed_key          = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.barbican_api_version  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.barbican_endpoint     = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.barbican_endpoint_type = public {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.barbican_region_name  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.cafile                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.certfile              = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.collect_timing        = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.insecure              = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.keyfile               = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.number_of_retries     = 60 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.retry_delay           = 1 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.send_service_user_token = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.split_loggers         = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.timeout               = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.tls_ciphers           = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.tls_min_version       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.verify_ssl            = True {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican.verify_ssl_path       = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.auth_section = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.auth_type = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.cafile   = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.certfile = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.collect_timing = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.insecure = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.keyfile  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.split_loggers = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.timeout  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.tls_ciphers = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] barbican_service_user.tls_min_version = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.approle_role_id          = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.approle_secret_id        = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.auth_method              = approle {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.auth_path                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.kv_mountpoint            = secret {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.kv_path                  = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.kv_version               = 2 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.namespace                = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.root_token_id            = **** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.ssl_ca_crt_file          = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.timeout                  = 60.0 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.token_file               = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.token_role               = None {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.use_ssl                  = False {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 25 18:25:02 devstack cinder-volume[86024]: DEBUG oslo_service.backend._eventlet.service [None req-d5929d30-493d-42bd-ae6e-b1962ed604d1 None None] ******************************************************************************** {{(pid=86024) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 25 18:25:02 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.560s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:25:02 devstack cinder-volume[86534]: INFO cinder.volume.driver [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Driver hasn't implemented _init_vendor_properties()
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG cinder.volume.driver [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2824325561523, 'free_capacity_gb': 1775.2824325561523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86534) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 25 18:25:02 devstack cinder-volume[86534]: DEBUG oslo_db.sqlalchemy.engines [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writer thread running {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.db.api [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Building query based on filter {{(pid=86534) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86534) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:25:03 devstack cinder-volume[86534]: INFO cinder.keymgr.migration [None req-76b43fb2-9a0b-4c06-9853-7613161b332b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 25 18:25:03 devstack sudo[86653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:25:03 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:25:03 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.526s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:25:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Driver initialization completed successfully.
Sep 25 18:25:03 devstack cinder-volume[86534]: INFO cinder.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Initiating service 3 cleanup
Sep 25 18:25:03 devstack cinder-volume[86534]: INFO cinder.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Service 3 cleanup completed.
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.service [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Creating RPC server for service cinder-volume {{(pid=86534) start /opt/stack/cinder/cinder/service.py:231}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.service [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86534) start /opt/stack/cinder/cinder/service.py:237}}
Sep 25 18:25:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:25:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:25:03 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:25:03 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:25:04 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Sep 25 18:25:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:25:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d41bd6c8-b834-437e-a828-b3d13fa7ad1c None None] Driver post RPC initialization completed successfully.
Sep 25 18:25:11 devstack cinder-volume[86024]: DEBUG dbcounter [-] [86024] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:25:13 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:25:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:25:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:25:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 6 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:25:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Flow 'volume_create_manager' (4d36dad2-98ac-47c7-92d2-9dc971fda105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eae1109-98eb-4c6b-b01c-3cb898b46b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eae1109-98eb-4c6b-b01c-3cb898b46b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1676170072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7391eee2-0260-4f61-8402-89b3d075d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537bcb4a38a54aeeb2d9b0334bfef993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:26:05Z,use_quota=True,user_id='a12304f0f1d9413fb16adbb6fa713823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7368ac3-6d86-44c5-82c7-4c1c1865a6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7368ac3-6d86-44c5-82c7-4c1c1865a6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e4cece-166f-4ce8-b1a3-28f098438a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e4cece-166f-4ce8-b1a3-28f098438a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7391eee2-0260-4f61-8402-89b3d075d16c', 'volume_name': 'volume-7391eee2-0260-4f61-8402-89b3d075d16c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742d82e6-12b5-403c-9410-32942cbc93fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742d82e6-12b5-403c-9410-32942cbc93fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64264e6-634a-43cf-9f08-b1abb5691259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:05 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Volume 7391eee2-0260-4f61-8402-89b3d075d16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7391eee2-0260-4f61-8402-89b3d075d16c', 'volume_size': 1}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1676170072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7391eee2-0260-4f61-8402-89b3d075d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='537bcb4a38a54aeeb2d9b0334bfef993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:26:05Z,use_quota=True,user_id='a12304f0f1d9413fb16adbb6fa713823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Creating volume 7391eee2-0260-4f61-8402-89b3d075d16c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:26:05 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:26:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:05 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c 1073741824
Sep 25 18:26:05 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:06 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c 1073741824" returned: 0 in 0.642s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:06 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c
Sep 25 18:26:06 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:06 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64264e6-634a-43cf-9f08-b1abb5691259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7391eee2-0260-4f61-8402-89b3d075d16c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a8b885-ebc5-47bb-9067-e68c5f04eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Volume volume-7391eee2-0260-4f61-8402-89b3d075d16c (7391eee2-0260-4f61-8402-89b3d075d16c): created successfully
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a8b885-ebc5-47bb-9067-e68c5f04eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Flow 'volume_create_manager' (4d36dad2-98ac-47c7-92d2-9dc971fda105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:26:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-303481e0-f67d-4d0e-9f43-9437edcf44f7 tempest-TaggedAttachmentsTest-1633975008 None] Created volume successfully.
Sep 25 18:26:16 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:26:16 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Flow 'volume_create_manager' (d5760c21-8b47-49d7-bc96-8c25f689c8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25575f21-ecee-4525-ab8e-575567a2ae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25575f21-ecee-4525-ab8e-575567a2ae50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2070976097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd50030-d871-4be5-9adf-280ca53f47e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e419ef3511774ef49ef4ffe2e09a5634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:26:20Z,use_quota=True,user_id='16848e35d8a64aa1bd40362445053f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef790308-a7ee-4fa8-883c-91a893bd4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef790308-a7ee-4fa8-883c-91a893bd4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c381d06-e1dc-42ef-8c1f-f28d1fed68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c381d06-e1dc-42ef-8c1f-f28d1fed68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd50030-d871-4be5-9adf-280ca53f47e2', 'volume_name': 'volume-3cd50030-d871-4be5-9adf-280ca53f47e2', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93a794e-085c-4281-8340-7089bda1a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93a794e-085c-4281-8340-7089bda1a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428a0641-d163-4b91-b134-3263e6d6c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:20 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Volume 3cd50030-d871-4be5-9adf-280ca53f47e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd50030-d871-4be5-9adf-280ca53f47e2', 'volume_size': 1}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2070976097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd50030-d871-4be5-9adf-280ca53f47e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e419ef3511774ef49ef4ffe2e09a5634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:26:20Z,use_quota=True,user_id='16848e35d8a64aa1bd40362445053f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Creating volume 3cd50030-d871-4be5-9adf-280ca53f47e2 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:26:20 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:26:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:20 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2 1073741824
Sep 25 18:26:20 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:21 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2 1073741824" returned: 0 in 0.835s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:21 devstack sudo[87737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2
Sep 25 18:26:21 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:21 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428a0641-d163-4b91-b134-3263e6d6c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd50030-d871-4be5-9adf-280ca53f47e2', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cd5eb1-0336-4b19-96f3-84cb31e843b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:21 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Volume volume-3cd50030-d871-4be5-9adf-280ca53f47e2 (3cd50030-d871-4be5-9adf-280ca53f47e2): created successfully
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cd5eb1-0336-4b19-96f3-84cb31e843b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Flow 'volume_create_manager' (d5760c21-8b47-49d7-bc96-8c25f689c8d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:26:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2bea2795-54f6-4417-833b-43241da0a555 tempest-DeleteServersTestJSON-1858319491 None] Created volume successfully.
Sep 25 18:26:27 devstack cinder-volume[86534]: WARNING py.warnings [req-eec1e025-9630-4af4-bf8e-c9c02dce483d req-8d09f9d0-2770-46f5-8fa9-dd8c6950aef2 tempest-DeleteServersTestJSON-1858319491 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 25 18:26:27 devstack cinder-volume[86534]:   .first()
Sep 25 18:26:27 devstack cinder-volume[86534]: 
Sep 25 18:26:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-eec1e025-9630-4af4-bf8e-c9c02dce483d req-8d09f9d0-2770-46f5-8fa9-dd8c6950aef2 tempest-DeleteServersTestJSON-1858319491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-eec1e025-9630-4af4-bf8e-c9c02dce483d req-8d09f9d0-2770-46f5-8fa9-dd8c6950aef2 tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-eec1e025-9630-4af4-bf8e-c9c02dce483d req-8d09f9d0-2770-46f5-8fa9-dd8c6950aef2 tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-eec1e025-9630-4af4-bf8e-c9c02dce483d req-8d09f9d0-2770-46f5-8fa9-dd8c6950aef2 tempest-DeleteServersTestJSON-1858319491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-3cd50030-d871-4be5-9adf-280ca53f47e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e610dc07-02e9-4a5a-aff4-5f460b6fa6ad', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:26:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-eec1e025-9630-4af4-bf8e-c9c02dce483d req-8d09f9d0-2770-46f5-8fa9-dd8c6950aef2 tempest-DeleteServersTestJSON-1858319491 None] attachment_update completed successfully.
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Flow 'volume_create_manager' (414d1924-a497-406d-ab52-275d1a707172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4aa733-f65e-4ad1-ba95-108c4e302d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4aa733-f65e-4ad1-ba95-108c4e302d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-98186329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe8b1e0-b123-4a34-bd61-f7520c939510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e71b04379cb47d581a13f4b5671edbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:26:33Z,use_quota=True,user_id='d2d0621f19ed49b7b765a71ebd9fd9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8565aadb-e521-461a-8186-f02424efa790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8565aadb-e521-461a-8186-f02424efa790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c37ef9-8876-41a1-8730-9f09035f4fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c37ef9-8876-41a1-8730-9f09035f4fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe8b1e0-b123-4a34-bd61-f7520c939510', 'volume_name': 'volume-4fe8b1e0-b123-4a34-bd61-f7520c939510', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98100fd7-2878-42d5-968b-350f5895f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98100fd7-2878-42d5-968b-350f5895f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b3cc52-4bd9-4f7a-8882-3a28efaa4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:33 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Volume 4fe8b1e0-b123-4a34-bd61-f7520c939510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe8b1e0-b123-4a34-bd61-f7520c939510', 'volume_size': 1}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-98186329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe8b1e0-b123-4a34-bd61-f7520c939510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e71b04379cb47d581a13f4b5671edbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:26:33Z,use_quota=True,user_id='d2d0621f19ed49b7b765a71ebd9fd9f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Creating volume 4fe8b1e0-b123-4a34-bd61-f7520c939510 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:26:33 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:26:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:33 devstack sudo[88412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 1073741824
Sep 25 18:26:33 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:35 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 1073741824" returned: 0 in 1.478s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:35 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510
Sep 25 18:26:35 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:35 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510" returned: 0 in 0.630s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b3cc52-4bd9-4f7a-8882-3a28efaa4e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe8b1e0-b123-4a34-bd61-f7520c939510', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6d418-b2d5-494b-9f6b-98aa5bdcb7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:26:35 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Volume volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 (4fe8b1e0-b123-4a34-bd61-f7520c939510): created successfully
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6d418-b2d5-494b-9f6b-98aa5bdcb7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:26:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Flow 'volume_create_manager' (414d1924-a497-406d-ab52-275d1a707172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:26:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-66a10846-1415-42a3-923b-7608a894f25d tempest-VolumesAdminNegativeTest-797776739 None] Created volume successfully.
Sep 25 18:26:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-7238f3bc-dbe4-4b51-adbe-3b12fb4d8149 req-db12606b-772d-42a6-912a-b88a85931f34 tempest-DeleteServersTestJSON-1858319491 None] Terminate volume connection completed successfully.
Sep 25 18:26:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-7238f3bc-dbe4-4b51-adbe-3b12fb4d8149 req-db12606b-772d-42a6-912a-b88a85931f34 tempest-DeleteServersTestJSON-1858319491 None] Deleting attachment e610dc07-02e9-4a5a-aff4-5f460b6fa6ad. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:26:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Acquiring lock "cinder-4fe8b1e0-b123-4a34-bd61-f7520c939510-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:26:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Lock "cinder-4fe8b1e0-b123-4a34-bd61-f7520c939510-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:26:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Acquiring lock "cinder-quobyte-4fe8b1e0-b123-4a34-bd61-f7520c939510" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:26:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Lock "cinder-quobyte-4fe8b1e0-b123-4a34-bd61-f7520c939510" acquired by "delete_volume" :: waited 0.045s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:26:38 devstack cinder-volume[86534]: INFO oslo.privsep.daemon [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdauo_996/privsep.sock']
Sep 25 18:26:38 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdauo_996/privsep.sock
Sep 25 18:26:38 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Acquiring lock "cinder-3cd50030-d871-4be5-9adf-280ca53f47e2-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Lock "cinder-3cd50030-d871-4be5-9adf-280ca53f47e2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Acquiring lock "cinder-quobyte-3cd50030-d871-4be5-9adf-280ca53f47e2" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Lock "cinder-quobyte-3cd50030-d871-4be5-9adf-280ca53f47e2" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 25 18:26:40 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:40 devstack cinder-volume[86534]: INFO oslo.privsep.daemon [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Spawned new privsep daemon via rootwrap
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Accepted privsep connection to /tmp/tmpdauo_996/privsep.sock {{(pid=86534) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 25 18:26:40 devstack cinder-volume[86534]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 25 18:26:40 devstack cinder-volume[86534]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 25 18:26:40 devstack cinder-volume[86534]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 25 18:26:40 devstack cinder-volume[86534]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88488
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[787381a7-24ff-4756-9593-187df88daf8d]: (2,) {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:26:40 devstack cinder-volume[86534]: WARNING oslo_privsep.priv_context [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] privsep daemon already running
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf70a84-64c4-4f5c-b65b-55f61a8cfa92]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[168238fb-fd2e-403c-83c7-18cde5750c42]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:26:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:41 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510
Sep 25 18:26:41 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:41 devstack sudo[88493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2
Sep 25 18:26:41 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:41 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510" returned: 0 in 0.775s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:41 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510
Sep 25 18:26:41 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:42 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2" returned: 0 in 1.017s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:42 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2
Sep 25 18:26:42 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:42 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4fe8b1e0-b123-4a34-bd61-f7520c939510" returned: 0 in 0.351s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Lock "cinder-quobyte-4fe8b1e0-b123-4a34-bd61-f7520c939510" released by "delete_volume" :: held 3.715s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:26:42 devstack cinder-volume[86534]: WARNING cinder.quota [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:26:42 devstack cinder-volume[86534]: WARNING cinder.quota [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Created reservations ['97b163cb-dfd4-41c6-92d1-bd537848286d', '1f98230c-52d6-4cb5-a6f7-77152b8d206b', '75a95e2b-a7ab-475c-a812-51ce75598a6c', '9d63a685-b301-42e2-a600-1610ba242736'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:42 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3cd50030-d871-4be5-9adf-280ca53f47e2" returned: 0 in 0.655s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:42 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:26:42 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Lock "cinder-quobyte-3cd50030-d871-4be5-9adf-280ca53f47e2" released by "delete_volume" :: held 2.305s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Created reservations ['d1823b94-af95-4057-a1c3-ef6aeed5b789', '1ae2abd3-0010-4578-ac06-b89d5293e78c', '551c6667-f12f-474a-b4cc-c103fb29e2f9', 'f7226326-7c72-4c6c-925b-3b3d3db84d73'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:43 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:26:43 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:43 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.663s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:43 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:26:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Deleted volume successfully.
Sep 25 18:26:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-54776832-b28f-4c74-8fac-ba7c6c0e2a0e tempest-VolumesAdminNegativeTest-797776739 None] Lock "cinder-4fe8b1e0-b123-4a34-bd61-f7520c939510-delete_volume" released by "delete_volume" :: held 5.128s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:26:43 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.701s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:43 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:26:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Deleted volume successfully.
Sep 25 18:26:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2178f06e-2076-4b9b-9e43-5b544344c13e tempest-DeleteServersTestJSON-1858319491 None] Lock "cinder-3cd50030-d871-4be5-9adf-280ca53f47e2-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:26:44 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:26:44 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:26:44 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.509s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 8 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:26:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:26:53 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:26:53 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:27:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:27:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:27:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-e97c236e-f080-44d5-aae6-23f849b563ed req-7bf34b88-4f00-4701-9e77-248d82e080ed tempest-TaggedAttachmentsTest-1633975008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-e97c236e-f080-44d5-aae6-23f849b563ed req-7bf34b88-4f00-4701-9e77-248d82e080ed tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-e97c236e-f080-44d5-aae6-23f849b563ed req-7bf34b88-4f00-4701-9e77-248d82e080ed tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-e97c236e-f080-44d5-aae6-23f849b563ed req-7bf34b88-4f00-4701-9e77-248d82e080ed tempest-TaggedAttachmentsTest-1633975008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-7391eee2-0260-4f61-8402-89b3d075d16c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5a1865d-d79d-4176-a06d-271976a21875', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:27:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-e97c236e-f080-44d5-aae6-23f849b563ed req-7bf34b88-4f00-4701-9e77-248d82e080ed tempest-TaggedAttachmentsTest-1633975008 None] attachment_update completed successfully.
Sep 25 18:27:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-7cc8eb30-803a-45da-86ca-64afff1fc56f req-5c7908ed-6636-4eb2-8fb2-2f2424941c9a tempest-TaggedAttachmentsTest-1633975008 None] Terminate volume connection completed successfully.
Sep 25 18:27:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-7cc8eb30-803a-45da-86ca-64afff1fc56f req-5c7908ed-6636-4eb2-8fb2-2f2424941c9a tempest-TaggedAttachmentsTest-1633975008 None] Deleting attachment d5a1865d-d79d-4176-a06d-271976a21875. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:27:34 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:27:34 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:27:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Flow 'volume_create_manager' (4f048649-1939-4bde-8106-990e9a5961c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e647476-0d97-4f6a-9979-b1ef800f4a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e647476-0d97-4f6a-9979-b1ef800f4a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-151869793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d72e84-0956-4d6e-b6f3-bb6834d1b20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa4cdd347dd4847add737518848e4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:27:42Z,use_quota=True,user_id='222f46f73db34a1f9cedce0e424c1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e70a06a-7717-4e83-8f5b-5b76749b1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e70a06a-7717-4e83-8f5b-5b76749b1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3df8f6b-6376-4d06-9c32-72bf95e1a29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3df8f6b-6376-4d06-9c32-72bf95e1a29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d72e84-0956-4d6e-b6f3-bb6834d1b20b', 'volume_name': 'volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c467dc-4be1-43dd-8ac5-f35176cc40a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c467dc-4be1-43dd-8ac5-f35176cc40a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b19aa76-79b8-4586-9f88-658b4e40f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Volume 38d72e84-0956-4d6e-b6f3-bb6834d1b20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b', 'volume_size': 1}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-151869793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d72e84-0956-4d6e-b6f3-bb6834d1b20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa4cdd347dd4847add737518848e4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:27:42Z,use_quota=True,user_id='222f46f73db34a1f9cedce0e424c1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Creating volume 38d72e84-0956-4d6e-b6f3-bb6834d1b20b {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:27:42 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:27:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:42 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b 1073741824
Sep 25 18:27:42 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:43 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b 1073741824" returned: 0 in 0.936s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:43 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b
Sep 25 18:27:43 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Acquiring lock "cinder-7391eee2-0260-4f61-8402-89b3d075d16c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Lock "cinder-7391eee2-0260-4f61-8402-89b3d075d16c-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Acquiring lock "cinder-quobyte-7391eee2-0260-4f61-8402-89b3d075d16c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Lock "cinder-quobyte-7391eee2-0260-4f61-8402-89b3d075d16c" acquired by "delete_volume" :: waited 0.061s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdfc53-52e2-4faa-b5c2-08da86d79edb]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:27:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:44 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c
Sep 25 18:27:44 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:44 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b" returned: 0 in 0.791s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b19aa76-79b8-4586-9f88-658b4e40f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:44 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:27:44 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df2f270-3786-48d8-b16c-215e393ff8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:44 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Volume volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b (38d72e84-0956-4d6e-b6f3-bb6834d1b20b): created successfully
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df2f270-3786-48d8-b16c-215e393ff8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Flow 'volume_create_manager' (4f048649-1939-4bde-8106-990e9a5961c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:27:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f9c847b6-c71f-4fcf-a6d5-19a0904f7326 tempest-ServerActionsTestOtherA-1239874874 None] Created volume successfully.
Sep 25 18:27:44 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c" returned: 0 in 0.808s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:44 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.589s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:44 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c
Sep 25 18:27:44 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 8 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:27:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Flow 'volume_create_manager' (aae12f17-6cf0-402d-ac62-99ce6db97ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fe2225-13c5-4a93-9aa3-a2a43c620f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fe2225-13c5-4a93-9aa3-a2a43c620f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-802540629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3bb924-bb4e-468a-8668-bb49d37090c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db03442a26e4fda94bc5e2d5ace154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:27:45Z,use_quota=True,user_id='b6bf04d74ea64e8281e9bfd1f6407e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23af5b06-e06e-4e2b-8481-bb3a1a55aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23af5b06-e06e-4e2b-8481-bb3a1a55aca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3186045e-e5cb-45ac-943e-a4c1c40f3db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3186045e-e5cb-45ac-943e-a4c1c40f3db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3bb924-bb4e-468a-8668-bb49d37090c8', 'volume_name': 'volume-de3bb924-bb4e-468a-8668-bb49d37090c8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb4bdfc-bc16-44e8-9757-1abd2abde5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb4bdfc-bc16-44e8-9757-1abd2abde5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece5e9ed-714d-4fca-a47c-a7bc17277c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Volume de3bb924-bb4e-468a-8668-bb49d37090c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3bb924-bb4e-468a-8668-bb49d37090c8', 'volume_size': 1}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-802540629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3bb924-bb4e-468a-8668-bb49d37090c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db03442a26e4fda94bc5e2d5ace154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:27:45Z,use_quota=True,user_id='b6bf04d74ea64e8281e9bfd1f6407e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Creating volume de3bb924-bb4e-468a-8668-bb49d37090c8 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:27:45 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:27:45 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7391eee2-0260-4f61-8402-89b3d075d16c" returned: 0 in 0.475s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:45 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8 1073741824
Sep 25 18:27:45 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Lock "cinder-quobyte-7391eee2-0260-4f61-8402-89b3d075d16c" released by "delete_volume" :: held 1.394s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Created reservations ['b3c9310c-9191-4fdc-ba1e-f8eabfede534', '6ad50013-49fa-47fd-9e71-c1317207f3e4', '237c8499-8c0b-4b39-a7e3-e67c9d81259b', '8f7bee23-1313-4a2d-8c0a-0e60e63b6db6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:45 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:27:45 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:45 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8 1073741824" returned: 0 in 0.745s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:27:45 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8
Sep 25 18:27:45 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:27:46 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.590s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:27:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Deleted volume successfully.
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-638cfa92-b1ce-4a83-814c-a009e2fb3f4b tempest-TaggedAttachmentsTest-1633975008 None] Lock "cinder-7391eee2-0260-4f61-8402-89b3d075d16c-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:27:46 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8" returned: 0 in 0.389s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece5e9ed-714d-4fca-a47c-a7bc17277c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3bb924-bb4e-468a-8668-bb49d37090c8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404b4054-9046-407c-aa15-3b52cb1878a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:27:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Volume volume-de3bb924-bb4e-468a-8668-bb49d37090c8 (de3bb924-bb4e-468a-8668-bb49d37090c8): created successfully
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404b4054-9046-407c-aa15-3b52cb1878a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:27:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Flow 'volume_create_manager' (aae12f17-6cf0-402d-ac62-99ce6db97ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:27:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-387d95f6-7194-4e4c-a844-acf6320fb764 tempest-ServerRescueNegativeTestJSON-2037664841 None] Created volume successfully.
Sep 25 18:27:56 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=14 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:27:56 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=9,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:28:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Acquiring lock "cinder-de3bb924-bb4e-468a-8668-bb49d37090c8-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "cinder-de3bb924-bb4e-468a-8668-bb49d37090c8-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Acquiring lock "cinder-quobyte-de3bb924-bb4e-468a-8668-bb49d37090c8" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "cinder-quobyte-de3bb924-bb4e-468a-8668-bb49d37090c8" acquired by "delete_volume" :: waited 0.098s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[79199047-fdc6-41c8-891f-31f25f1dfffe]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:10 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8
Sep 25 18:28:10 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:10 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8" returned: 0 in 0.982s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:10 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8
Sep 25 18:28:10 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:11 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-de3bb924-bb4e-468a-8668-bb49d37090c8" returned: 0 in 0.801s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "cinder-quobyte-de3bb924-bb4e-468a-8668-bb49d37090c8" released by "delete_volume" :: held 1.944s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:11 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Created reservations ['b15e8b8e-b7a3-4504-b112-5bfb830c922c', '2082dde3-10e9-49ef-9ff1-e6bcfd93ae6b', '360e0610-9f24-4fd1-b35c-48b1fee165c0', 'b02b5d52-594d-454d-8f3a-5c8622ffa61f'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:12 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:12 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.811s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:12 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Deleted volume successfully.
Sep 25 18:28:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6897f7d9-866a-4c39-b629-4475326cca32 tempest-ServerRescueNegativeTestJSON-2037664841 None] Lock "cinder-de3bb924-bb4e-468a-8668-bb49d37090c8-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Flow 'volume_create_manager' (5a0b418d-d3b4-4b7e-a30d-73a563e20906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a232aa93-d12d-4a47-a896-854667d047b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a232aa93-d12d-4a47-a896-854667d047b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-942016521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dae5b66-ed14-485a-885d-82f812d76ac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f64ea9ff14c40178506d440bb5c689d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:15Z,use_quota=True,user_id='241a126d5a1b47cb95e3469d3d0ade1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e758e181-886e-46e2-b264-cfaf4a793123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e758e181-886e-46e2-b264-cfaf4a793123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02977ad-e4de-4e5b-ac4f-5a5ec286e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02977ad-e4de-4e5b-ac4f-5a5ec286e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dae5b66-ed14-485a-885d-82f812d76ac8', 'volume_name': 'volume-2dae5b66-ed14-485a-885d-82f812d76ac8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bfa49c-cabb-4d86-bd29-b4cb4a18220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9bfa49c-cabb-4d86-bd29-b4cb4a18220c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b8e12b-7476-4799-be8a-dc43ee391abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:15 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Volume 2dae5b66-ed14-485a-885d-82f812d76ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dae5b66-ed14-485a-885d-82f812d76ac8', 'volume_size': 1}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-942016521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dae5b66-ed14-485a-885d-82f812d76ac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7f64ea9ff14c40178506d440bb5c689d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:15Z,use_quota=True,user_id='241a126d5a1b47cb95e3469d3d0ade1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Creating volume 2dae5b66-ed14-485a-885d-82f812d76ac8 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:28:15 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:28:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:15 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8 1073741824
Sep 25 18:28:15 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:17 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8 1073741824" returned: 0 in 1.577s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:17 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8
Sep 25 18:28:17 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:18 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8" returned: 0 in 1.060s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] <== create_volume: return (2779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.781s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b8e12b-7476-4799-be8a-dc43ee391abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dae5b66-ed14-485a-885d-82f812d76ac8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37885573-3fa8-4d8c-b5f5-0d307ba7102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:18 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Volume volume-2dae5b66-ed14-485a-885d-82f812d76ac8 (2dae5b66-ed14-485a-885d-82f812d76ac8): created successfully
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37885573-3fa8-4d8c-b5f5-0d307ba7102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Flow 'volume_create_manager' (5a0b418d-d3b4-4b7e-a30d-73a563e20906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-d0423ba1-4416-4528-9acc-53aaf8b18f8c req-50af9948-d44e-4ebc-a92d-d3289c91fb58 tempest-VolumesGetTestJSON-617075765 None] Created volume successfully.
Sep 25 18:28:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Acquiring lock "cinder-2dae5b66-ed14-485a-885d-82f812d76ac8-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Lock "cinder-2dae5b66-ed14-485a-885d-82f812d76ac8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Acquiring lock "cinder-quobyte-2dae5b66-ed14-485a-885d-82f812d76ac8" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Lock "cinder-quobyte-2dae5b66-ed14-485a-885d-82f812d76ac8" acquired by "delete_volume" :: waited 0.047s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:19 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80fbeb6-86c2-46e0-85ce-77591f4f62d2]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:20 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8
Sep 25 18:28:20 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:21 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8" returned: 0 in 1.100s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:21 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8
Sep 25 18:28:21 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:21 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2dae5b66-ed14-485a-885d-82f812d76ac8" returned: 0 in 0.454s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Lock "cinder-quobyte-2dae5b66-ed14-485a-885d-82f812d76ac8" released by "delete_volume" :: held 1.655s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG cinder.quota [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Created reservations ['0014c838-d6fa-4819-98fe-19df84e9de74', 'be87ca70-e33d-4966-b742-4189940b3e80', '1a1b6efe-ba32-473c-93cd-c9d1db55c103', '51aa2835-a249-43fe-bd22-22a8b727560c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:22 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:22 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:22 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:22 devstack cinder-volume[86534]: DEBUG cinder.manager [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Deleted volume successfully.
Sep 25 18:28:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-5790eed0-59d7-4152-8856-6a48802ebb76 req-fa6ccc4e-39c3-42fe-bfdb-c8321e9a013d tempest-VolumesGetTestJSON-617075765 None] Lock "cinder-2dae5b66-ed14-485a-885d-82f812d76ac8-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Flow 'volume_create_manager' (f458ff06-574f-41d9-a917-cb919163da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e91e5-0c4e-477c-b12f-1f64391d55ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e91e5-0c4e-477c-b12f-1f64391d55ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1425065170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9f136e-6d8a-4929-8e41-fe0903c55b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39bec050bdf47f6b0e0448f38359ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:28Z,use_quota=True,user_id='3a9235e2e4b84aeeb6fb1c806b309a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7822fb48-7676-4995-a74e-93d8e6ef7e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7822fb48-7676-4995-a74e-93d8e6ef7e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a5bd58-44b3-4106-adb5-72c74d1cea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a5bd58-44b3-4106-adb5-72c74d1cea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9f136e-6d8a-4929-8e41-fe0903c55b33', 'volume_name': 'volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2e34bc-8daf-458c-bc56-7937fc42562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2e34bc-8daf-458c-bc56-7937fc42562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3fcc77-6be2-4af9-a190-ca2ad4f2c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:28 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Volume 5c9f136e-6d8a-4929-8e41-fe0903c55b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33', 'volume_size': 1}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1425065170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9f136e-6d8a-4929-8e41-fe0903c55b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39bec050bdf47f6b0e0448f38359ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:28Z,use_quota=True,user_id='3a9235e2e4b84aeeb6fb1c806b309a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Creating volume 5c9f136e-6d8a-4929-8e41-fe0903c55b33 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:28:28 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:28 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 1073741824
Sep 25 18:28:28 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:28 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 1073741824" returned: 0 in 0.570s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:28 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33
Sep 25 18:28:28 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:29 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3fcc77-6be2-4af9-a190-ca2ad4f2c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d07332-bb27-4066-9ee1-ec97ce730a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Volume volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 (5c9f136e-6d8a-4929-8e41-fe0903c55b33): created successfully
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d07332-bb27-4066-9ee1-ec97ce730a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Flow 'volume_create_manager' (f458ff06-574f-41d9-a917-cb919163da4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-99916a67-8f2c-46e8-8c7d-e47079e9d890 tempest-ServersNegativeTestJSON-1859180046 None] Created volume successfully.
Sep 25 18:28:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9d11392-a77d-4a94-9d3d-d07894507dc1 tempest-GroupSnapshotsTest-1198205474 None] Group tempest-GroupSnapshotsTest-Group-1682498228: creating
Sep 25 18:28:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9d11392-a77d-4a94-9d3d-d07894507dc1 tempest-GroupSnapshotsTest-1198205474 None] Group tempest-GroupSnapshotsTest-Group-1682498228: created successfully
Sep 25 18:28:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9d11392-a77d-4a94-9d3d-d07894507dc1 tempest-GroupSnapshotsTest-1198205474 None] Create group completed successfully.
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (ae31a834-1ea4-403c-9ad9-79100cd130f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379727a5-0225-49d8-9a29-c90e182f8ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379727a5-0225-49d8-9a29-c90e182f8ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-499516383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41fa72fe-2e16-4648-9dc5-704d201cde9a,host='devstack@QuobyteHD#QuobyteHD',id=687cdb9f-adfb-4672-89a6-5e6cce844fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:31Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2527179-c546-48f7-b7d4-63aa44060f4a),volume_type_id=b2527179-c546-48f7-b7d4-63aa44060f4a)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b83050-0a50-43f5-a5a8-8bbe267bb130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b83050-0a50-43f5-a5a8-8bbe267bb130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c35863-27aa-40ae-9e1f-02895ac8d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c35863-27aa-40ae-9e1f-02895ac8d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687cdb9f-adfb-4672-89a6-5e6cce844fc7', 'volume_name': 'volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffc359e-e2c1-4e91-91cd-e0e12b9cb2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffc359e-e2c1-4e91-91cd-e0e12b9cb2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159c3bbb-50df-4dcf-a5a2-ad0c9e53a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Volume 687cdb9f-adfb-4672-89a6-5e6cce844fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7', 'volume_size': 1}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=41fa72fe-2e16-4648-9dc5-704d201cde9a,created_at=2026-09-25T16:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-499516383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=41fa72fe-2e16-4648-9dc5-704d201cde9a,host='devstack@QuobyteHD#QuobyteHD',id=687cdb9f-adfb-4672-89a6-5e6cce844fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:31Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2527179-c546-48f7-b7d4-63aa44060f4a),volume_type_id=b2527179-c546-48f7-b7d4-63aa44060f4a)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Creating volume 687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:28:31 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:31 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 1073741824
Sep 25 18:28:31 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Flow 'volume_create_manager' (20aafc31-9cb1-43ab-bb58-fb15ed1e9420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68647179-6a98-460c-a992-a102391f6761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68647179-6a98-460c-a992-a102391f6761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-148739787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39bec050bdf47f6b0e0448f38359ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:32Z,use_quota=True,user_id='3a9235e2e4b84aeeb6fb1c806b309a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c88048-de8f-467a-b0b1-9f08f6ff19bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c88048-de8f-467a-b0b1-9f08f6ff19bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0232bee0-7ea6-4030-8e8e-4e21e9ae07ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0232bee0-7ea6-4030-8e8e-4e21e9ae07ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d', 'volume_name': 'volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1679c7fc-dfc1-4960-a67f-c557767ce0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1679c7fc-dfc1-4960-a67f-c557767ce0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4521577-9dc6-43bf-8758-7cf1d60aa3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:31 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Volume 2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d', 'volume_size': 1}
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:31 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 1073741824" returned: 0 in 0.615s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:32 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7
Sep 25 18:28:32 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:32 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-148739787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39bec050bdf47f6b0e0448f38359ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:32Z,use_quota=True,user_id='3a9235e2e4b84aeeb6fb1c806b309a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Creating volume 2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:28:32 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159c3bbb-50df-4dcf-a5a2-ad0c9e53a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e700c3-0b45-4331-af56-016139016c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:32 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d 1073741824
Sep 25 18:28:32 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:32 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Volume volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 (687cdb9f-adfb-4672-89a6-5e6cce844fc7): created successfully
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e700c3-0b45-4331-af56-016139016c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (ae31a834-1ea4-403c-9ad9-79100cd130f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b75c5206-706d-4984-829f-a7f034fae200 tempest-GroupSnapshotsTest-1198205474 None] Created volume successfully.
Sep 25 18:28:32 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d 1073741824" returned: 0 in 0.606s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] GroupSnapshot b477f2b3-3be6-415c-b47f-d09ef0e2df81: creating.
Sep 25 18:28:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:33 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d
Sep 25 18:28:33 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Group snapshot b477f2b3-3be6-415c-b47f-d09ef0e2df81: creating. {{(pid=86534) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:33 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d" returned: 0 in 0.270s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.190s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4521577-9dc6-43bf-8758-7cf1d60aa3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e85d56-8d4c-4ecc-aee3-6875de76a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Creating offline snapshot a22c06da-dbf4-4576-8d5b-c6369195c2d4 of volume 687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:28:33 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Volume volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d (2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d): created successfully
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e85d56-8d4c-4ecc-aee3-6875de76a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Flow 'volume_create_manager' (20aafc31-9cb1-43ab-bb58-fb15ed1e9420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2050e349-0b2a-41d1-9dd9-f4b62febd79a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:33 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-51c34d68-57b6-4255-9489-582d964b9f4a tempest-ServersNegativeTestJSON-1859180046 None] Created volume successfully.
Sep 25 18:28:33 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7
Sep 25 18:28:33 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:33 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7" returned: 0 in 0.393s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:33 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 1G
Sep 25 18:28:33 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:34 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 1G" returned: 0 in 0.546s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:34 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4
Sep 25 18:28:34 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "cinder-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "cinder-quobyte-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-quobyte-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3ca448-cd1c-4257-add4-41f788837d0f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:34 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:34 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:34 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d
Sep 25 18:28:34 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:34 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4
Sep 25 18:28:34 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:34 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:34 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d" returned: 0 in 0.455s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:34 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info
Sep 25 18:28:34 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:34 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d
Sep 25 18:28:34 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:35 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info" returned: 0 in 0.299s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:35 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:35 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:35 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info
Sep 25 18:28:35 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-quobyte-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d" released by "delete_volume" :: held 0.808s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Created reservations ['059199a7-b65d-4c77-9155-577df414d92a', 'aa9c25c3-43eb-42f1-9188-99824a00ee4c', '425ff8f9-5980-41dd-8684-47a239c757b8', '23582613-9ca3-49f7-bc96-0f6a3b9ad708'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:35 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:35 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:35 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "cinder-5c9f136e-6d8a-4929-8e41-fe0903c55b33-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.info" returned: 0 in 0.325s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-5c9f136e-6d8a-4929-8e41-fe0903c55b33-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "cinder-quobyte-5c9f136e-6d8a-4929-8e41-fe0903c55b33" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-quobyte-5c9f136e-6d8a-4929-8e41-fe0903c55b33" acquired by "delete_volume" :: waited 0.028s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:35 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df2af3a-0517-42a1-bfe6-8bd2a85127fa]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e571a7db-c7df-49ab-9757-d5867cfe6d69 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot b477f2b3-3be6-415c-b47f-d09ef0e2df81: created successfully
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Deleted volume successfully.
Sep 25 18:28:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-72735688-907a-4df7-8b2c-b68e14f50b6e tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-2fad60dd-5ebd-4af7-b0a1-9e0ef45b218d-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:35 devstack sudo[90389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33
Sep 25 18:28:35 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:36 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33" returned: 0 in 0.372s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:36 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33
Sep 25 18:28:36 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:36 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5c9f136e-6d8a-4929-8e41-fe0903c55b33" returned: 0 in 0.312s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-quobyte-5c9f136e-6d8a-4929-8e41-fe0903c55b33" released by "delete_volume" :: held 0.746s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Created reservations ['4d2e63b3-f063-49af-a287-4f22d53f1949', 'ea665866-e48d-4e97-b700-68dd3810a147', 'ca944ac9-cb6e-40df-a7c4-0df34c3b9434', '11ad1596-4a79-4c97-bfcf-d04f2a166985'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:36 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:36 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:37 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.468s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Deleted volume successfully.
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0714e2e8-b04f-41b9-9aec-f68fba1a518d tempest-ServersNegativeTestJSON-1859180046 None] Lock "cinder-5c9f136e-6d8a-4929-8e41-fe0903c55b33-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-a22c06da-dbf4-4576-8d5b-c6369195c2d4-3913b808-9643-4ab0-82ad-999b43fc9399" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-a22c06da-dbf4-4576-8d5b-c6369195c2d4-3913b808-9643-4ab0-82ad-999b43fc9399" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Creating volume 3913b808-9643-4ab0-82ad-999b43fc9399 from snapshot a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-3913b808-9643-4ab0-82ad-999b43fc9399" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-3913b808-9643-4ab0-82ad-999b43fc9399" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] snapshot: a22c06da-dbf4-4576-8d5b-c6369195c2d4, volume: 3913b808-9643-4ab0-82ad-999b43fc9399,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482f7ef-2477-4f9a-a68d-76c656b63fbc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:37 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4
Sep 25 18:28:37 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:37 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4" returned: 0 in 0.587s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4b726d-87fd-43fd-93d5-9ae3ce9092b8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:38 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7
Sep 25 18:28:38 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:38 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7" returned: 0 in 0.511s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:28:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:28:38 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:28:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:38 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399
Sep 25 18:28:38 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:44 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:44 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:44 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.375s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 8 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:28:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=52,cinder:SELECT=28,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=48,cinder:INSERT=10,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:28:47 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399" returned: 0 in 9.093s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7, size 1024.00 MB, duration 9.09 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:28:47 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Converted 1024.00 MB image at 112.59 MB/s
Sep 25 18:28:47 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:47 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399
Sep 25 18:28:47 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:47 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399" returned: 0 in 0.304s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-3913b808-9643-4ab0-82ad-999b43fc9399" released by "_copy_volume_from_snapshot" :: held 10.641s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-a22c06da-dbf4-4576-8d5b-c6369195c2d4-3913b808-9643-4ab0-82ad-999b43fc9399" released by "_create_volume_from_snapshot" :: held 10.753s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.774s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e1add1cc-7bb4-47cd-ba1b-f35baa2708ba tempest-GroupSnapshotsTest-1198205474 None] Create group from source-snapshot-b477f2b3-3be6-415c-b47f-d09ef0e2df81 completed successfully.
Sep 25 18:28:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-3913b808-9643-4ab0-82ad-999b43fc9399" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-3913b808-9643-4ab0-82ad-999b43fc9399" acquired by "delete_volume" :: waited 0.028s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79ebae-b752-4bc7-b0ce-e352ce02959a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:49 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399
Sep 25 18:28:49 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:49 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399" returned: 0 in 0.490s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:49 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399
Sep 25 18:28:49 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-bc724993-118d-468c-90f6-ef187b0eac20 req-f7e10482-be7d-4393-89bb-e4c7b38008a7 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-bc724993-118d-468c-90f6-ef187b0eac20 req-f7e10482-be7d-4393-89bb-e4c7b38008a7 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-bc724993-118d-468c-90f6-ef187b0eac20 req-f7e10482-be7d-4393-89bb-e4c7b38008a7 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-bc724993-118d-468c-90f6-ef187b0eac20 req-f7e10482-be7d-4393-89bb-e4c7b38008a7 tempest-ServerActionsTestOtherA-1239874874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea54ad9f-e805-43c1-8b76-181827a756fe', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:28:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-bc724993-118d-468c-90f6-ef187b0eac20 req-f7e10482-be7d-4393-89bb-e4c7b38008a7 tempest-ServerActionsTestOtherA-1239874874 None] attachment_update completed successfully.
Sep 25 18:28:49 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3913b808-9643-4ab0-82ad-999b43fc9399" returned: 0 in 0.312s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-3913b808-9643-4ab0-82ad-999b43fc9399" released by "delete_volume" :: held 0.904s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['cda53a73-b9ff-43ab-a1f3-43f747edf94b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:49 devstack cinder-volume[86534]: WARNING cinder.quota [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1100201412 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1100201412, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:28:49 devstack cinder-volume[86534]: WARNING cinder.quota [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1100201412 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1100201412, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:28:49 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['41cf9270-b80f-42e7-949a-07854e1cfba7', '4ec786f5-b7ef-4947-841d-943d120b59a3', '1e60c0fd-1ce0-491f-8a0e-40aac60717b8', 'e12e97f0-2786-4bfa-b1fc-ee75fe9b8003'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:50 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:50 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] group_snapshot b477f2b3-3be6-415c-b47f-d09ef0e2df81: deleting
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] group_snapshot b477f2b3-3be6-415c-b47f-d09ef0e2df81: deleting {{(pid=86534) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-687cdb9f-adfb-4672-89a6-5e6cce844fc7" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-687cdb9f-adfb-4672-89a6-5e6cce844fc7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-a22c06da-dbf4-4576-8d5b-c6369195c2d4" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-a22c06da-dbf4-4576-8d5b-c6369195c2d4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Deleting offline snapshot a22c06da-dbf4-4576-8d5b-c6369195c2d4 of volume 687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] snapshot_file for this snap is: volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a6bf90-923f-46dd-a1ed-72cb97f416f5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:50 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.514s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:50 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-82c44159-03f4-40c5-8749-cf4a6d1833cf tempest-GroupSnapshotsTest-1198205474 None] Delete group completed successfully.
Sep 25 18:28:50 devstack sudo[90924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4
Sep 25 18:28:50 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:51 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4" returned: 0 in 0.542s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:28:51 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd176f5d-838a-457d-bf80-1de78309efac]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:51 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7
Sep 25 18:28:51 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:51 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7" returned: 0 in 0.676s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:51 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4
Sep 25 18:28:51 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:52 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4" returned: 0 in 0.386s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:52 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4
Sep 25 18:28:52 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:52 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7.a22c06da-dbf4-4576-8d5b-c6369195c2d4" returned: 0 in 0.318s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-a22c06da-dbf4-4576-8d5b-c6369195c2d4" released by "_delete_snapshot" :: held 2.089s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-687cdb9f-adfb-4672-89a6-5e6cce844fc7" released by "delete_snapshot" :: held 2.129s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:52 devstack cinder-volume[86534]: WARNING cinder.quota [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1100201412 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1100201412, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:28:52 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['f2834f63-24b7-40f8-a10e-e6097c677443', 'e8877245-4da0-49ce-b1a5-d6380a62185a', '01acf8a8-9f01-477b-a0cd-5480af0cb67d', 'e56bcfdf-a740-4cee-8db6-adabba678a16'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8abbe5bc-e8e4-4a2a-a991-961273cae43f tempest-GroupSnapshotsTest-1198205474 None] group_snapshot b477f2b3-3be6-415c-b47f-d09ef0e2df81: deleted successfully
Sep 25 18:28:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-687cdb9f-adfb-4672-89a6-5e6cce844fc7" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:28:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-687cdb9f-adfb-4672-89a6-5e6cce844fc7" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:28:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1434580b-2ed8-4875-b3ed-53bf3698cb5e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:28:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:53 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7
Sep 25 18:28:53 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:53 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7" returned: 0 in 0.499s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:54 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7
Sep 25 18:28:54 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:54 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-687cdb9f-adfb-4672-89a6-5e6cce844fc7" returned: 0 in 0.376s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-687cdb9f-adfb-4672-89a6-5e6cce844fc7" released by "delete_volume" :: held 1.008s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:28:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-de578151-b133-4929-96c3-156c67c502cf req-b0dc54f9-dfde-48f6-a439-616628a3daf1 tempest-ServerActionsTestOtherA-1239874874 None] Terminate volume connection completed successfully.
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-de578151-b133-4929-96c3-156c67c502cf req-b0dc54f9-dfde-48f6-a439-616628a3daf1 tempest-ServerActionsTestOtherA-1239874874 None] Deleting attachment ea54ad9f-e805-43c1-8b76-181827a756fe. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['22486d1e-0d03-4ff2-86a0-a12504382091'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:54 devstack cinder-volume[86534]: WARNING cinder.db.api [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1100201412']
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['8c6c261b-5ef2-4124-af3f-adbfd2fd9126', 'dba13a4d-045b-4427-bf18-b28d19dccb44', '9e22546b-1af3-4d5a-936c-cbd1ae6a2f46', '75e7ac9d-4e34-4169-9e03-00538fbb5680'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:55 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:28:55 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:55 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.453s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:55 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:28:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d734a11f-70f8-4dc9-a091-ffad23c9834f tempest-GroupSnapshotsTest-1198205474 None] Delete group completed successfully.
Sep 25 18:28:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-de578151-b133-4929-96c3-156c67c502cf req-ded79ece-3093-4b64-aee2-ebdfd55eadb1 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-de578151-b133-4929-96c3-156c67c502cf req-ded79ece-3093-4b64-aee2-ebdfd55eadb1 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-de578151-b133-4929-96c3-156c67c502cf req-ded79ece-3093-4b64-aee2-ebdfd55eadb1 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-de578151-b133-4929-96c3-156c67c502cf req-ded79ece-3093-4b64-aee2-ebdfd55eadb1 tempest-ServerActionsTestOtherA-1239874874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5082077-ece0-448c-9d3c-6c59f9b83b44', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:28:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-de578151-b133-4929-96c3-156c67c502cf req-ded79ece-3093-4b64-aee2-ebdfd55eadb1 tempest-ServerActionsTestOtherA-1239874874 None] attachment_update completed successfully.
Sep 25 18:28:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1655903b-c410-4013-89ee-d7c829a88a6f tempest-GroupSnapshotsTest-1198205474 None] Group tempest-GroupSnapshotsTest-Group-675819154: creating
Sep 25 18:28:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1655903b-c410-4013-89ee-d7c829a88a6f tempest-GroupSnapshotsTest-1198205474 None] Group tempest-GroupSnapshotsTest-Group-675819154: created successfully
Sep 25 18:28:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1655903b-c410-4013-89ee-d7c829a88a6f tempest-GroupSnapshotsTest-1198205474 None] Create group completed successfully.
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (db4d83af-c990-477c-ad21-9810dddc3047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4bd294-0505-42b3-bc14-ba2386664b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4bd294-0505-42b3-bc14-ba2386664b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587884175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3e76912a-b2d9-48d4-8bf0-ef3969c948e5,host='devstack@QuobyteHD#QuobyteHD',id=5d7257f7-8299-461c-b95b-5cc56418d382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:59Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f255b9f0-d8b5-427e-815b-50454b14a57f),volume_type_id=f255b9f0-d8b5-427e-815b-50454b14a57f)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed140caa-5d0b-4450-be18-f234c1887303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed140caa-5d0b-4450-be18-f234c1887303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c333e4-9bff-44e3-af75-2ca77dcecaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c333e4-9bff-44e3-af75-2ca77dcecaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7257f7-8299-461c-b95b-5cc56418d382', 'volume_name': 'volume-5d7257f7-8299-461c-b95b-5cc56418d382', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa52f49-abc4-4366-bf24-f0119af84149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa52f49-abc4-4366-bf24-f0119af84149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08611f2d-47fb-40f1-b08f-8f69ea7d846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:28:58 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Volume 5d7257f7-8299-461c-b95b-5cc56418d382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7257f7-8299-461c-b95b-5cc56418d382', 'volume_size': 1}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3e76912a-b2d9-48d4-8bf0-ef3969c948e5,created_at=2026-09-25T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587884175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3e76912a-b2d9-48d4-8bf0-ef3969c948e5,host='devstack@QuobyteHD#QuobyteHD',id=5d7257f7-8299-461c-b95b-5cc56418d382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:28:59Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f255b9f0-d8b5-427e-815b-50454b14a57f),volume_type_id=f255b9f0-d8b5-427e-815b-50454b14a57f)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Creating volume 5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:28:58 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:28:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:59 devstack sudo[91503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 1073741824
Sep 25 18:28:59 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:28:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e9c7eb26-d98b-402f-9369-3f6907d51543 tempest-GroupsTest-507087164 None] Group tempest-Group1-1289518914: creating
Sep 25 18:28:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e9c7eb26-d98b-402f-9369-3f6907d51543 tempest-GroupsTest-507087164 None] Group tempest-Group1-1289518914: created successfully
Sep 25 18:28:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e9c7eb26-d98b-402f-9369-3f6907d51543 tempest-GroupsTest-507087164 None] Create group completed successfully.
Sep 25 18:28:59 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root
Sep 25 18:28:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 1073741824" returned: 0 in 0.715s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:28:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:28:59 devstack sudo[91528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382
Sep 25 18:28:59 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:00 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382" returned: 0 in 0.335s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08611f2d-47fb-40f1-b08f-8f69ea7d846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7257f7-8299-461c-b95b-5cc56418d382', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768491e5-84b9-4a9e-9ae5-d115bf994e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:00 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Volume volume-5d7257f7-8299-461c-b95b-5cc56418d382 (5d7257f7-8299-461c-b95b-5cc56418d382): created successfully
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768491e5-84b9-4a9e-9ae5-d115bf994e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (db4d83af-c990-477c-ad21-9810dddc3047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e17d2f4e-73b0-42eb-95fa-cf29fb8bf43a tempest-GroupSnapshotsTest-1198205474 None] Created volume successfully.
Sep 25 18:29:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6949fcff-76fc-4744-93ba-e1731e65d2f1 tempest-GroupsTest-507087164 None] Group tempest-Group2-915550767: creating
Sep 25 18:29:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6949fcff-76fc-4744-93ba-e1731e65d2f1 tempest-GroupsTest-507087164 None] Group tempest-Group2-915550767: created successfully
Sep 25 18:29:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6949fcff-76fc-4744-93ba-e1731e65d2f1 tempest-GroupsTest-507087164 None] Create group completed successfully.
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (950d1def-fef4-41db-93c0-f605c00b54a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca86de52-29fd-4220-bef3-8f6df7acb988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca86de52-29fd-4220-bef3-8f6df7acb988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-975243931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3e76912a-b2d9-48d4-8bf0-ef3969c948e5,host='devstack@QuobyteHD#QuobyteHD',id=1138a8b5-6808-40fd-ade9-60811246fb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:02Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f255b9f0-d8b5-427e-815b-50454b14a57f),volume_type_id=f255b9f0-d8b5-427e-815b-50454b14a57f)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3779a8-810a-4311-aa1e-d1e3a79028ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3779a8-810a-4311-aa1e-d1e3a79028ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99232c5-7b8c-44df-a413-10ec18e287b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99232c5-7b8c-44df-a413-10ec18e287b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1138a8b5-6808-40fd-ade9-60811246fb16', 'volume_name': 'volume-1138a8b5-6808-40fd-ade9-60811246fb16', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c660015d-7ebd-48b0-971e-f72ebc7a6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c660015d-7ebd-48b0-971e-f72ebc7a6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7f73ec-252a-446a-bdd9-1c7348694d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:02 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Volume 1138a8b5-6808-40fd-ade9-60811246fb16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1138a8b5-6808-40fd-ade9-60811246fb16', 'volume_size': 1}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3e76912a-b2d9-48d4-8bf0-ef3969c948e5,created_at=2026-09-25T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-975243931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3e76912a-b2d9-48d4-8bf0-ef3969c948e5,host='devstack@QuobyteHD#QuobyteHD',id=1138a8b5-6808-40fd-ade9-60811246fb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:02Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f255b9f0-d8b5-427e-815b-50454b14a57f),volume_type_id=f255b9f0-d8b5-427e-815b-50454b14a57f)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Creating volume 1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:02 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:02 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 1073741824
Sep 25 18:29:02 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Flow 'volume_create_manager' (f9751739-b4cb-4f1c-88cd-bde50fa1933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc7ae71-e9da-48ba-a67a-fe77436917c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc7ae71-e9da-48ba-a67a-fe77436917c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529694638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8788acb4-802d-4fe2-b314-c735413f939b,host='devstack@QuobyteHD#QuobyteHD',id=b9aad501-26ca-4234-953e-85f4f833edf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0552c9fd069b44b3b172f21b1705d402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:03Z,use_quota=True,user_id='222c3e4980eb464fb057d333e4d70586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5300dd90-7108-4a40-bd2f-5157be4c6206),volume_type_id=5300dd90-7108-4a40-bd2f-5157be4c6206)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e971f228-47d2-4a30-b64b-f1f4281271af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e971f228-47d2-4a30-b64b-f1f4281271af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cc2d1d-f930-4ce7-80c9-ddba05221da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cc2d1d-f930-4ce7-80c9-ddba05221da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9aad501-26ca-4234-953e-85f4f833edf9', 'volume_name': 'volume-b9aad501-26ca-4234-953e-85f4f833edf9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0328a6-2b20-43cf-92fa-b9f7387c174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0328a6-2b20-43cf-92fa-b9f7387c174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51e9656-882c-4232-b1da-14dfde9f08a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Volume b9aad501-26ca-4234-953e-85f4f833edf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9aad501-26ca-4234-953e-85f4f833edf9', 'volume_size': 1}
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:03 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 1073741824" returned: 0 in 1.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:04 devstack sudo[91642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16
Sep 25 18:29:04 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:04 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16" returned: 0 in 0.682s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8788acb4-802d-4fe2-b314-c735413f939b,created_at=2026-09-25T16:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-529694638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8788acb4-802d-4fe2-b314-c735413f939b,host='devstack@QuobyteHD#QuobyteHD',id=b9aad501-26ca-4234-953e-85f4f833edf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0552c9fd069b44b3b172f21b1705d402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:03Z,use_quota=True,user_id='222c3e4980eb464fb057d333e4d70586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5300dd90-7108-4a40-bd2f-5157be4c6206),volume_type_id=5300dd90-7108-4a40-bd2f-5157be4c6206)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Creating volume b9aad501-26ca-4234-953e-85f4f833edf9 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:04 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7f73ec-252a-446a-bdd9-1c7348694d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1138a8b5-6808-40fd-ade9-60811246fb16', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aa9d56-7059-4ccb-b4d0-272415bb2e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:04 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9 1073741824
Sep 25 18:29:04 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:04 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Volume volume-1138a8b5-6808-40fd-ade9-60811246fb16 (1138a8b5-6808-40fd-ade9-60811246fb16): created successfully
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36aa9d56-7059-4ccb-b4d0-272415bb2e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (950d1def-fef4-41db-93c0-f605c00b54a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d8c82704-3c0d-47a5-894c-4b3b88035ad0 tempest-GroupSnapshotsTest-1198205474 None] Created volume successfully.
Sep 25 18:29:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cb81df41-73b5-4f1b-a425-1c747b4504a0 tempest-GroupSnapshotsTest-1198205474 None] Update group completed successfully.
Sep 25 18:29:05 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9 1073741824" returned: 0 in 0.908s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:05 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9
Sep 25 18:29:05 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:05 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51e9656-882c-4232-b1da-14dfde9f08a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9aad501-26ca-4234-953e-85f4f833edf9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7e952f-23cd-4460-b981-4ea59e126301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Volume volume-b9aad501-26ca-4234-953e-85f4f833edf9 (b9aad501-26ca-4234-953e-85f4f833edf9): created successfully
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7e952f-23cd-4460-b981-4ea59e126301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Flow 'volume_create_manager' (f9751739-b4cb-4f1c-88cd-bde50fa1933f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f36b3dab-ac51-4284-bd62-335652f5e21c tempest-GroupsTest-507087164 None] Created volume successfully.
Sep 25 18:29:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cbde9af1-84e0-4d8d-89e5-a659c2529da8 tempest-GroupSnapshotsTest-1198205474 None] Update group completed successfully.
Sep 25 18:29:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Acquiring lock "cinder-quobyte-b9aad501-26ca-4234-953e-85f4f833edf9" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Lock "cinder-quobyte-b9aad501-26ca-4234-953e-85f4f833edf9" acquired by "delete_volume" :: waited 0.039s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-18926262-6291-45a1-915c-76d05917bc03 tempest-GroupSnapshotsTest-1198205474 None] Update group completed successfully.
Sep 25 18:29:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aee220-efce-4b45-8051-cf426169b289]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:08 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9
Sep 25 18:29:08 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:08 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9" returned: 0 in 0.517s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:08 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9
Sep 25 18:29:08 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:09 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b9aad501-26ca-4234-953e-85f4f833edf9" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Lock "cinder-quobyte-b9aad501-26ca-4234-953e-85f4f833edf9" released by "delete_volume" :: held 0.885s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Created reservations ['40b9e69e-38c6-4d91-9992-1fcf93acda03'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:09 devstack cinder-volume[86534]: WARNING cinder.quota [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1464838849 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1464838849, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:09 devstack cinder-volume[86534]: WARNING cinder.quota [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1464838849 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1464838849, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Created reservations ['3a661a22-f6db-43c1-b47b-7c16314c4328', '8c30a6f0-9dcc-4620-8327-78c5f5708bea', '0ce75f3a-fb7b-48a6-a3c5-5c3e9b8c7a40', '0fadf2eb-2759-468c-ab75-42389c4dfaa4'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:09 devstack sudo[91682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:29:09 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:09 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1a7a700a-dc78-4d47-b86e-fb5ebb8d4d89 tempest-GroupSnapshotsTest-1198205474 None] Update group completed successfully.
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Created reservations ['56b467d0-254d-4d01-bcd3-bea640815e62'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:09 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.464s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:29:09 devstack sudo[91685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:29:09 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:09 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b73fb8da-8c56-4a6c-a3b2-648ffddaca86 tempest-GroupsTest-507087164 None] Delete group completed successfully.
Sep 25 18:29:09 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:09 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:29:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-31e163b5-6543-43da-883d-878273e19fb0 tempest-GroupsTest-507087164 None] Delete group completed successfully.
Sep 25 18:29:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] GroupSnapshot 49e856eb-0dda-4a85-9a7e-3bda00162537: creating.
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Group snapshot 49e856eb-0dda-4a85-9a7e-3bda00162537: creating. {{(pid=86534) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Creating offline snapshot eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 of volume 1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866f3bf-05a4-4812-8da1-8ac999ab12fd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-10b63a74-cf1b-4677-8916-78ffae72f931 tempest-GroupsTest-507087164 None] Group tempest-GroupsTest-Group-1656765684: creating
Sep 25 18:29:11 devstack sudo[91688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16
Sep 25 18:29:11 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-10b63a74-cf1b-4677-8916-78ffae72f931 tempest-GroupsTest-507087164 None] Group tempest-GroupsTest-Group-1656765684: created successfully
Sep 25 18:29:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-10b63a74-cf1b-4677-8916-78ffae72f931 tempest-GroupsTest-507087164 None] Create group completed successfully.
Sep 25 18:29:11 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16" returned: 0 in 0.475s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:11 devstack sudo[91693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 1G
Sep 25 18:29:11 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:12 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 1G" returned: 0 in 0.394s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1138a8b5-6808-40fd-ade9-60811246fb16 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:12 devstack sudo[91699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1138a8b5-6808-40fd-ade9-60811246fb16 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4
Sep 25 18:29:12 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:12 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1138a8b5-6808-40fd-ade9-60811246fb16 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:12 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:29:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:12 devstack sudo[91705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4
Sep 25 18:29:12 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:12 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:12 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info
Sep 25 18:29:12 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:13 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info" returned: 0 in 0.390s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:13 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Flow 'volume_create_manager' (4f810d48-24d2-4a22-bb3e-f28808299489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:13 devstack sudo[91711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6734144-ab85-44da-bc04-5168777f29ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:13 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6734144-ab85-44da-bc04-5168777f29ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988540643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7bde5c8-2099-48ac-9c2e-e4f488666e03,host='devstack@QuobyteHD#QuobyteHD',id=00ce7516-8cbe-46b5-aea1-a95615aec216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0552c9fd069b44b3b172f21b1705d402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:13Z,use_quota=True,user_id='222c3e4980eb464fb057d333e4d70586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(253fc303-c442-463b-88c4-86b4b8123688),volume_type_id=253fc303-c442-463b-88c4-86b4b8123688)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d8cc23-1a00-4bc0-91ab-a15e91f03201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d8cc23-1a00-4bc0-91ab-a15e91f03201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb03bf75-b1ff-4c25-a2c7-b6de1f9b159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb03bf75-b1ff-4c25-a2c7-b6de1f9b159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ce7516-8cbe-46b5-aea1-a95615aec216', 'volume_name': 'volume-00ce7516-8cbe-46b5-aea1-a95615aec216', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a97e76-f22e-4b51-b5f9-1875d78ff6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a97e76-f22e-4b51-b5f9-1875d78ff6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6028c1e7-d093-4c4a-9283-2a9087680de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:13 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Volume 00ce7516-8cbe-46b5-aea1-a95615aec216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ce7516-8cbe-46b5-aea1-a95615aec216', 'volume_size': 1}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:13 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.info" returned: 0 in 0.271s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Creating offline snapshot f567fe25-b0a1-4b99-a1c5-b1fb073094c8 of volume 5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c6f069-ed49-4e1a-86dc-e18c40d673e6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:13 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382
Sep 25 18:29:13 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:13 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:14 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 1G
Sep 25 18:29:14 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:14 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 1G" returned: 0 in 0.435s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7257f7-8299-461c-b95b-5cc56418d382 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:14 devstack sudo[91727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7257f7-8299-461c-b95b-5cc56418d382 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8
Sep 25 18:29:14 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:14 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d7257f7-8299-461c-b95b-5cc56418d382 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8" returned: 0 in 0.323s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:14 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:29:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:14 devstack sudo[91732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8
Sep 25 18:29:14 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:14 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:15 devstack sudo[91741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info
Sep 25 18:29:15 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:15 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info" returned: 0 in 0.301s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:15 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:15 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info
Sep 25 18:29:15 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:15 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.info" returned: 0 in 0.273s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c7bde5c8-2099-48ac-9c2e-e4f488666e03,created_at=2026-09-25T16:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-988540643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7bde5c8-2099-48ac-9c2e-e4f488666e03,host='devstack@QuobyteHD#QuobyteHD',id=00ce7516-8cbe-46b5-aea1-a95615aec216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0552c9fd069b44b3b172f21b1705d402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:13Z,use_quota=True,user_id='222c3e4980eb464fb057d333e4d70586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(253fc303-c442-463b-88c4-86b4b8123688),volume_type_id=253fc303-c442-463b-88c4-86b4b8123688)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Creating volume 00ce7516-8cbe-46b5-aea1-a95615aec216 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:15 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:15 devstack sudo[91764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216 1073741824
Sep 25 18:29:15 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:15 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-67db0293-dab8-45e9-aea4-10ba0a549c7f tempest-GroupSnapshotsTest-1198205474 None] group_snapshot 49e856eb-0dda-4a85-9a7e-3bda00162537: created successfully
Sep 25 18:29:16 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216 1073741824" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:16 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216
Sep 25 18:29:16 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:16 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6028c1e7-d093-4c4a-9283-2a9087680de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ce7516-8cbe-46b5-aea1-a95615aec216', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8380e87a-5a8c-4708-8bf5-24a93961ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:16 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Volume volume-00ce7516-8cbe-46b5-aea1-a95615aec216 (00ce7516-8cbe-46b5-aea1-a95615aec216): created successfully
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8380e87a-5a8c-4708-8bf5-24a93961ad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Flow 'volume_create_manager' (4f810d48-24d2-4a22-bb3e-f28808299489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1ce2e773-d749-4659-b1c2-49fee05b49f3 tempest-GroupsTest-507087164 None] Created volume successfully.
Sep 25 18:29:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot 49e856eb-0dda-4a85-9a7e-3bda00162537: deleting
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot 49e856eb-0dda-4a85-9a7e-3bda00162537: deleting {{(pid=86534) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-1138a8b5-6808-40fd-ade9-60811246fb16" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-1138a8b5-6808-40fd-ade9-60811246fb16" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Deleting offline snapshot eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 of volume 1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] snapshot_file for this snap is: volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec713c-cbff-4dc5-baba-91654038737f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:16 devstack sudo[91787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4
Sep 25 18:29:16 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:17 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" returned: 0 in 0.457s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1138a8b5-6808-40fd-ade9-60811246fb16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b0f06-1c6f-4c0c-91b2-136f8cc195a3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:17 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16
Sep 25 18:29:17 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Flow 'volume_create_manager' (631ce92f-3fbc-40ff-b770-ae469d272043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b0b4a-3859-4db7-8d7a-459c3d26c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b0b4a-3859-4db7-8d7a-459c3d26c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1666236257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7bde5c8-2099-48ac-9c2e-e4f488666e03,host='devstack@QuobyteHD#QuobyteHD',id=b812fae9-e9be-4210-864d-bd4e1f334cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0552c9fd069b44b3b172f21b1705d402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:17Z,use_quota=True,user_id='222c3e4980eb464fb057d333e4d70586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(253fc303-c442-463b-88c4-86b4b8123688),volume_type_id=253fc303-c442-463b-88c4-86b4b8123688)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fd6df4-a21d-447e-b944-7abba51642dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fd6df4-a21d-447e-b944-7abba51642dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07719940-a2fe-403b-9e74-cbbe1cdd7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07719940-a2fe-403b-9e74-cbbe1cdd7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b812fae9-e9be-4210-864d-bd4e1f334cfe', 'volume_name': 'volume-b812fae9-e9be-4210-864d-bd4e1f334cfe', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec680a1-a13a-4899-809a-db489e4a52b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec680a1-a13a-4899-809a-db489e4a52b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f35428-561d-425c-bd26-0b253191d0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:17 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Volume b812fae9-e9be-4210-864d-bd4e1f334cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b812fae9-e9be-4210-864d-bd4e1f334cfe', 'volume_size': 1}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c7bde5c8-2099-48ac-9c2e-e4f488666e03,created_at=2026-09-25T16:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1666236257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c7bde5c8-2099-48ac-9c2e-e4f488666e03,host='devstack@QuobyteHD#QuobyteHD',id=b812fae9-e9be-4210-864d-bd4e1f334cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0552c9fd069b44b3b172f21b1705d402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:17Z,use_quota=True,user_id='222c3e4980eb464fb057d333e4d70586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(253fc303-c442-463b-88c4-86b4b8123688),volume_type_id=253fc303-c442-463b-88c4-86b4b8123688)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Creating volume b812fae9-e9be-4210-864d-bd4e1f334cfe {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:17 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:17 devstack sudo[91841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe 1073741824
Sep 25 18:29:17 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:17 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16" returned: 0 in 0.429s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:17 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4
Sep 25 18:29:17 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:17 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe 1073741824" returned: 0 in 0.421s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:18 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:18 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe
Sep 25 18:29:18 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:18 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4
Sep 25 18:29:18 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:18 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16.eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:18 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe" returned: 0 in 0.282s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-eb9f09d9-66b8-4155-8ef9-9b7a35536ed4" released by "_delete_snapshot" :: held 1.623s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f35428-561d-425c-bd26-0b253191d0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b812fae9-e9be-4210-864d-bd4e1f334cfe', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1756671-d94e-4ffa-aa0e-bd6e04bf8a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-1138a8b5-6808-40fd-ade9-60811246fb16" released by "delete_snapshot" :: held 1.665s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:18 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Volume volume-b812fae9-e9be-4210-864d-bd4e1f334cfe (b812fae9-e9be-4210-864d-bd4e1f334cfe): created successfully
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1756671-d94e-4ffa-aa0e-bd6e04bf8a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Flow 'volume_create_manager' (631ce92f-3fbc-40ff-b770-ae469d272043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-5d7257f7-8299-461c-b95b-5cc56418d382" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-88cbf03d-dce2-4f44-a127-7361e7e612e7 tempest-GroupsTest-507087164 None] Created volume successfully.
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-5d7257f7-8299-461c-b95b-5cc56418d382" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-f567fe25-b0a1-4b99-a1c5-b1fb073094c8" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-f567fe25-b0a1-4b99-a1c5-b1fb073094c8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Deleting offline snapshot f567fe25-b0a1-4b99-a1c5-b1fb073094c8 of volume 5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] snapshot_file for this snap is: volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0555557-bc8c-4afa-aec7-161f0b2c04cf]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:18 devstack sudo[91862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8
Sep 25 18:29:18 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:18 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8" returned: 0 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d7257f7-8299-461c-b95b-5cc56418d382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:29:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-514ee005-4493-437d-9d11-a537c3fa254a tempest-GroupsTest-507087164 None] Update group completed successfully.
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66a2be5-78c5-449e-9098-bd88becb01cf]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:18 devstack sudo[91868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382
Sep 25 18:29:18 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:19 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382" returned: 0 in 0.351s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:19 devstack sudo[91873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8
Sep 25 18:29:19 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:19 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8" returned: 0 in 0.324s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:19 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8
Sep 25 18:29:19 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:19 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382.f567fe25-b0a1-4b99-a1c5-b1fb073094c8" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-f567fe25-b0a1-4b99-a1c5-b1fb073094c8" released by "_delete_snapshot" :: held 1.409s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-5d7257f7-8299-461c-b95b-5cc56418d382" released by "delete_snapshot" :: held 1.433s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:19 devstack cinder-volume[86534]: WARNING cinder.quota [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-996357179 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-996357179, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:19 devstack cinder-volume[86534]: WARNING cinder.quota [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-996357179 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-996357179, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:19 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['815b0fd1-4c37-483d-8ec3-9365e69f2455', 'a4a5e8b6-8001-49d8-85b2-23d8ee5705ac', 'c2dbd16e-c78b-4845-987b-fa696f629008', '348ab0b1-2b21-4dad-9efa-9128a5bf063a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['9bb9d893-26ed-4d44-8648-f22b5be035cf', '949e7d4e-e2e8-4d28-83f3-8d79df2eed96', '9e323c6a-066d-4bee-a6fc-943776bd2c72', '0edc2bad-b016-4490-90bb-09b3f5eaf7b5'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b53125db-3cc4-4c64-b446-4df6a93656a0 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot 49e856eb-0dda-4a85-9a7e-3bda00162537: deleted successfully
Sep 25 18:29:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e5638e6b-ba48-40bd-9722-420b10ce0b51 tempest-GroupsTest-507087164 None] Update group completed successfully.
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-1138a8b5-6808-40fd-ade9-60811246fb16" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-1138a8b5-6808-40fd-ade9-60811246fb16" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b68bf-83bb-426e-999c-13f2f9fc0289]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:20 devstack sudo[91882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16
Sep 25 18:29:20 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:20 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16" returned: 0 in 0.365s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:20 devstack sudo[91887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16
Sep 25 18:29:20 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:21 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1138a8b5-6808-40fd-ade9-60811246fb16" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-1138a8b5-6808-40fd-ade9-60811246fb16" released by "delete_volume" :: held 0.707s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-5d7257f7-8299-461c-b95b-5cc56418d382" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-5d7257f7-8299-461c-b95b-5cc56418d382" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0010e8d3-6719-4f8f-8672-e66b16e9bb52]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:21 devstack sudo[91890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382
Sep 25 18:29:21 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:21 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382" returned: 0 in 0.453s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:21 devstack sudo[91896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382
Sep 25 18:29:21 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Acquiring lock "cinder-quobyte-00ce7516-8cbe-46b5-aea1-a95615aec216" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Lock "cinder-quobyte-00ce7516-8cbe-46b5-aea1-a95615aec216" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f76bdb4-5d27-48e5-83be-5e5a8f35b6a5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:22 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5d7257f7-8299-461c-b95b-5cc56418d382" returned: 0 in 0.378s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-5d7257f7-8299-461c-b95b-5cc56418d382" released by "delete_volume" :: held 0.921s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:22 devstack sudo[91933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216
Sep 25 18:29:22 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['4598d607-d442-46fb-9b18-fcc52c045e59'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:22 devstack cinder-volume[86534]: WARNING cinder.quota [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-996357179 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-996357179, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['96174adc-0945-4ab4-bdd0-30ec5b9c2ae1', '671084ff-a21d-4e17-87c3-cb4ac90ab3f5', '81710ad0-084a-4f1a-a3ff-470bd1a7d581', 'adfba72d-b6d0-494e-a796-212f788834cd'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['d8aef46b-9737-4b63-86ef-32263e89e1da', '556d00ce-a3f2-4f3b-9ad8-3f1c730d8b30', 'd0e8dc54-a45b-4996-b4be-f7b9daa7ac25', '096e183f-7496-4251-9afe-7c86cc7ffb3a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:22 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216" returned: 0 in 0.493s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:22 devstack sudo[91940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:29:22 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:22 devstack sudo[91941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216
Sep 25 18:29:22 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:22 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:29:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-38516c24-f5a6-4864-9177-554c305e45fe tempest-GroupSnapshotsTest-1198205474 None] Delete group completed successfully.
Sep 25 18:29:22 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-00ce7516-8cbe-46b5-aea1-a95615aec216" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Lock "cinder-quobyte-00ce7516-8cbe-46b5-aea1-a95615aec216" released by "delete_volume" :: held 0.887s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Acquiring lock "cinder-quobyte-b812fae9-e9be-4210-864d-bd4e1f334cfe" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Lock "cinder-quobyte-b812fae9-e9be-4210-864d-bd4e1f334cfe" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[037999ed-3143-4a66-b268-7325c8ff59fa]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:23 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe
Sep 25 18:29:23 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:23 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:23 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe
Sep 25 18:29:23 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d2549124-d54a-4605-8451-9d9a4a43271f tempest-GroupSnapshotsTest-1198205474 None] Group tempest-GroupSnapshotsTest-Group-798543622: creating
Sep 25 18:29:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d2549124-d54a-4605-8451-9d9a4a43271f tempest-GroupSnapshotsTest-1198205474 None] Group tempest-GroupSnapshotsTest-Group-798543622: created successfully
Sep 25 18:29:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d2549124-d54a-4605-8451-9d9a4a43271f tempest-GroupSnapshotsTest-1198205474 None] Create group completed successfully.
Sep 25 18:29:23 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b812fae9-e9be-4210-864d-bd4e1f334cfe" returned: 0 in 0.299s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Lock "cinder-quobyte-b812fae9-e9be-4210-864d-bd4e1f334cfe" released by "delete_volume" :: held 0.811s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Created reservations ['ce890e67-18d9-4055-9a42-19448ad0e299'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:23 devstack cinder-volume[86534]: WARNING cinder.quota [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1997349010 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1997349010, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:23 devstack cinder-volume[86534]: WARNING cinder.quota [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1997349010 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1997349010, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Created reservations ['a25436a7-1093-4b70-8f42-10d372ebe2df', 'c5e265c7-4c96-48fa-b88c-010426cded05', 'de7c87d9-9c64-4fda-80f2-6543a7148307', '174fe13d-7ad9-4bd8-a2a2-f18d64a05ecc'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Created reservations ['997c4e45-7919-439e-a470-2413428df2a8', 'e78247e4-84d6-4b7a-a265-59f7ee4a5753', 'fdeed419-4411-4354-88da-7f6b0ad5085d', 'f0f9ba8a-9c7b-4e7c-97f3-4f351f1db990'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:24 devstack sudo[91957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:29:24 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:24 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:24 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:29:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-03309c29-f52d-4e46-8364-aacb2a0b3277 tempest-GroupsTest-507087164 None] Delete group completed successfully.
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (74418b9d-1a25-4ef0-9b09-528501ab7ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2047f276-810a-4cfb-9ace-ba66e8e380b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-81a5642c-2c7f-4cf1-a148-c2932069c3cd req-cd6b7ec9-b136-4224-b247-c49f3442205d tempest-ServerActionsTestOtherA-1239874874 None] Terminate volume connection completed successfully.
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-81a5642c-2c7f-4cf1-a148-c2932069c3cd req-cd6b7ec9-b136-4224-b247-c49f3442205d tempest-ServerActionsTestOtherA-1239874874 None] Deleting attachment e5082077-ece0-448c-9d3c-6c59f9b83b44. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2047f276-810a-4cfb-9ace-ba66e8e380b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268967943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a69db3a4-f1fb-46a6-bad2-41ea89b954ed,host='devstack@QuobyteHD#QuobyteHD',id=d919000f-ca06-4349-b9ae-bf75f3e70943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:25Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a035e59d-eb21-46f8-a371-42c1fdc38cbc),volume_type_id=a035e59d-eb21-46f8-a371-42c1fdc38cbc)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcad00ac-b290-4ca5-85bd-4a0a535628b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcad00ac-b290-4ca5-85bd-4a0a535628b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cba0c6-e301-4bb9-9b17-2503e949d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cba0c6-e301-4bb9-9b17-2503e949d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd919000f-ca06-4349-b9ae-bf75f3e70943', 'volume_name': 'volume-d919000f-ca06-4349-b9ae-bf75f3e70943', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6443a7d-4223-40a0-80e8-5ffe30a32b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6443a7d-4223-40a0-80e8-5ffe30a32b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5e189-b48b-4de8-bb98-6d675f9cd254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:25 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Volume d919000f-ca06-4349-b9ae-bf75f3e70943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d919000f-ca06-4349-b9ae-bf75f3e70943', 'volume_size': 1}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a69db3a4-f1fb-46a6-bad2-41ea89b954ed,created_at=2026-09-25T16:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268967943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a69db3a4-f1fb-46a6-bad2-41ea89b954ed,host='devstack@QuobyteHD#QuobyteHD',id=d919000f-ca06-4349-b9ae-bf75f3e70943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2ce10e9170444a8b430ec2e8e041be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:25Z,use_quota=True,user_id='6db82777aee84465a94ebf98a16c6941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a035e59d-eb21-46f8-a371-42c1fdc38cbc),volume_type_id=a035e59d-eb21-46f8-a371-42c1fdc38cbc)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Creating volume d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:25 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:25 devstack sudo[91968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 1073741824
Sep 25 18:29:25 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:26 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 1073741824" returned: 0 in 0.549s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:26 devstack sudo[91974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943
Sep 25 18:29:26 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:26 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943" returned: 0 in 0.447s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5e189-b48b-4de8-bb98-6d675f9cd254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d919000f-ca06-4349-b9ae-bf75f3e70943', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70c1550-dedf-4e05-9d9c-b3577955eef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Volume volume-d919000f-ca06-4349-b9ae-bf75f3e70943 (d919000f-ca06-4349-b9ae-bf75f3e70943): created successfully
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70c1550-dedf-4e05-9d9c-b3577955eef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Flow 'volume_create_manager' (74418b9d-1a25-4ef0-9b09-528501ab7ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-26c2cb3c-adbf-426b-b668-646a5b3ce950 tempest-GroupSnapshotsTest-1198205474 None] Created volume successfully.
Sep 25 18:29:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] GroupSnapshot e285d602-aaf8-439f-8961-24367e298ca6: creating.
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Group snapshot e285d602-aaf8-439f-8961-24367e298ca6: creating. {{(pid=86534) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Creating offline snapshot 4caece04-bcfe-49e3-9ea7-1e5602212153 of volume d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eef3c4-f453-4dc8-b98b-a935910e52b8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:28 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943
Sep 25 18:29:28 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Flow 'volume_create_manager' (73ff9526-93e7-4a0f-9e3c-c09c7eeb18dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4473fbbc-97e4-47c7-a028-57b8fe4e6568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4473fbbc-97e4-47c7-a028-57b8fe4e6568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990044952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248c1121-29e5-4a1a-86e2-872807527a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8152040b0f0c46b494b2f3cb2114116b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:29Z,use_quota=True,user_id='b35681d92c884bc2bc4e5baa14e9c336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e1779d-2733-468e-a6a4-21009cac57da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e1779d-2733-468e-a6a4-21009cac57da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9125fce1-47cd-48db-b969-f7e53fe08a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9125fce1-47cd-48db-b969-f7e53fe08a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248c1121-29e5-4a1a-86e2-872807527a7d', 'volume_name': 'volume-248c1121-29e5-4a1a-86e2-872807527a7d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352eba62-253d-429c-b189-debf1cf0d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:28 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352eba62-253d-429c-b189-debf1cf0d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96d9bc8-3e95-4d93-8e14-8dc0d3bc5526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:28 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Volume 248c1121-29e5-4a1a-86e2-872807527a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248c1121-29e5-4a1a-86e2-872807527a7d', 'volume_size': 1}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943" returned: 0 in 0.560s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:28 devstack sudo[92014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 1G
Sep 25 18:29:28 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:29 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 1G" returned: 0 in 0.532s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d919000f-ca06-4349-b9ae-bf75f3e70943 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:29 devstack sudo[92022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d919000f-ca06-4349-b9ae-bf75f3e70943 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153
Sep 25 18:29:29 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:29 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d919000f-ca06-4349-b9ae-bf75f3e70943 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153" returned: 0 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:29 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:29:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:29 devstack sudo[92027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153
Sep 25 18:29:29 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:29 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:29 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info
Sep 25 18:29:29 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:30 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info" returned: 0 in 0.321s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:30 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:30 devstack sudo[92035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info
Sep 25 18:29:30 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:30 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.info" returned: 0 in 0.325s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-990044952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248c1121-29e5-4a1a-86e2-872807527a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8152040b0f0c46b494b2f3cb2114116b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:29Z,use_quota=True,user_id='b35681d92c884bc2bc4e5baa14e9c336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Creating volume 248c1121-29e5-4a1a-86e2-872807527a7d {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:30 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:30 devstack sudo[92038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d 1073741824
Sep 25 18:29:30 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-57da7558-515c-4b67-8d9f-c72be2427c08 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot e285d602-aaf8-439f-8961-24367e298ca6: created successfully
Sep 25 18:29:31 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d 1073741824" returned: 0 in 0.477s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:31 devstack sudo[92044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d
Sep 25 18:29:31 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:31 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96d9bc8-3e95-4d93-8e14-8dc0d3bc5526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248c1121-29e5-4a1a-86e2-872807527a7d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4575cb64-9ca8-475c-b24c-681a18aa9c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:31 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Volume volume-248c1121-29e5-4a1a-86e2-872807527a7d (248c1121-29e5-4a1a-86e2-872807527a7d): created successfully
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4575cb64-9ca8-475c-b24c-681a18aa9c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Flow 'volume_create_manager' (73ff9526-93e7-4a0f-9e3c-c09c7eeb18dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-81d11638-5af8-41ed-abcc-17c6e1945300 tempest-AttachVolumeNegativeTest-1017368670 None] Created volume successfully.
Sep 25 18:29:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot e285d602-aaf8-439f-8961-24367e298ca6: deleting
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot e285d602-aaf8-439f-8961-24367e298ca6: deleting {{(pid=86534) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-d919000f-ca06-4349-b9ae-bf75f3e70943" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-d919000f-ca06-4349-b9ae-bf75f3e70943" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-4caece04-bcfe-49e3-9ea7-1e5602212153" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-4caece04-bcfe-49e3-9ea7-1e5602212153" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Deleting offline snapshot 4caece04-bcfe-49e3-9ea7-1e5602212153 of volume d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] snapshot_file for this snap is: volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9eea14-dfd8-4358-9a46-797ed6b1c00d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:31 devstack sudo[92047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153
Sep 25 18:29:31 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:32 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153" returned: 0 in 0.499s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d919000f-ca06-4349-b9ae-bf75f3e70943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:29:32 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c802b0a2-3f0f-4a25-93b7-8571c7b6bb07]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:32 devstack sudo[92057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943
Sep 25 18:29:32 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:32 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943" returned: 0 in 0.450s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:32 devstack sudo[92063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153
Sep 25 18:29:32 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-e1075b57-5211-4acc-9417-69851b52caac req-3809cc21-b587-4ced-8715-e67db3e29b55 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-e1075b57-5211-4acc-9417-69851b52caac req-3809cc21-b587-4ced-8715-e67db3e29b55 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:33 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153" returned: 0 in 0.486s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-e1075b57-5211-4acc-9417-69851b52caac req-3809cc21-b587-4ced-8715-e67db3e29b55 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:33 devstack sudo[92076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153
Sep 25 18:29:33 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-e1075b57-5211-4acc-9417-69851b52caac req-3809cc21-b587-4ced-8715-e67db3e29b55 tempest-AttachVolumeNegativeTest-1017368670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-248c1121-29e5-4a1a-86e2-872807527a7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e248e10-a83a-45ea-aab1-eeddf6c841f1', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:29:33 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-e1075b57-5211-4acc-9417-69851b52caac req-3809cc21-b587-4ced-8715-e67db3e29b55 tempest-AttachVolumeNegativeTest-1017368670 None] attachment_update completed successfully.
Sep 25 18:29:33 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943.4caece04-bcfe-49e3-9ea7-1e5602212153" returned: 0 in 0.279s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-4caece04-bcfe-49e3-9ea7-1e5602212153" released by "_delete_snapshot" :: held 1.895s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-d919000f-ca06-4349-b9ae-bf75f3e70943" released by "delete_snapshot" :: held 1.920s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:33 devstack cinder-volume[86534]: WARNING cinder.quota [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-598573999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-598573999, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:33 devstack cinder-volume[86534]: WARNING cinder.quota [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-598573999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-598573999, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:33 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['c8ed4293-d13e-4db9-8b01-11d6cf0e0686', '62ae9902-4b45-424a-85ee-e2124ae316ca', '9eba81f4-a997-4f88-ac83-032af7146f41', '3d61166a-a248-40f5-81ad-1e1c83cf263d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:33 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6138292a-e60d-4185-8356-3a1c7dc866b7 tempest-GroupSnapshotsTest-1198205474 None] group_snapshot e285d602-aaf8-439f-8961-24367e298ca6: deleted successfully
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "cinder-quobyte-d919000f-ca06-4349-b9ae-bf75f3e70943" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-d919000f-ca06-4349-b9ae-bf75f3e70943" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b8d4ac-a203-4b29-b636-84a051da368e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:34 devstack sudo[92495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943
Sep 25 18:29:34 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Flow 'volume_create_manager' (f4110685-1b06-452e-a98d-5df488f2e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b1fe21-e273-40f0-8fff-b521f7b137c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b1fe21-e273-40f0-8fff-b521f7b137c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1215920300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b081b92-78c8-4231-af15-9acf1b0c62fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa4cdd347dd4847add737518848e4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:34Z,use_quota=True,user_id='222f46f73db34a1f9cedce0e424c1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ecafb8-d0f3-49bb-8872-7e53a3a74715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ecafb8-d0f3-49bb-8872-7e53a3a74715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb8ea4d-a9f9-4044-9c44-fd65d241ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:29:34 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943" returned: 0 in 0.451s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:34 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943
Sep 25 18:29:34 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb8ea4d-a9f9-4044-9c44-fd65d241ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b081b92-78c8-4231-af15-9acf1b0c62fa', 'volume_name': 'volume-5b081b92-78c8-4231-af15-9acf1b0c62fa', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7ebe210>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389c9751-9024-46d6-bee1-f35d98a26aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389c9751-9024-46d6-bee1-f35d98a26aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b4a4d-99d2-4d45-b3e9-2ff63e6cc07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:35 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Volume 5b081b92-78c8-4231-af15-9acf1b0c62fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b081b92-78c8-4231-af15-9acf1b0c62fa', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7ebe210>}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Trying to clone 5b081b92-78c8-4231-af15-9acf1b0c62fa from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:29:35 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d919000f-ca06-4349-b9ae-bf75f3e70943" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Lock "cinder-quobyte-d919000f-ca06-4349-b9ae-bf75f3e70943" released by "delete_volume" :: held 0.902s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['96b0f689-e698-447b-ba3e-7a1003de5221'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:35 devstack cinder-volume[86534]: WARNING cinder.quota [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-598573999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-598573999, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Created reservations ['c147e010-cf54-4cb7-abf0-8b5c9e6b531e', '70c95bbd-7927-4faf-bc62-fc5dfad04908', '407a71b1-3060-42d2-9da8-6ffe4e81ff24', 'c9f188c3-a8fb-4797-9c74-91d78a3d4f4a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:29:35 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[365967b6-84bc-4cbb-841b-b0686376fd4e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:35 devstack sudo[92525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:29:35 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:35 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD
Sep 25 18:29:35 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:36 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:29:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4f6b36ba-8197-4cd5-8e7b-4c686a94a65e tempest-GroupSnapshotsTest-1198205474 None] Delete group completed successfully.
Sep 25 18:29:36 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 is fetched for user 222f46f73db34a1f9cedce0e424c1f2b. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[95712dc2-b36a-4c56-ab59-aa6f7ea141a5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:36 devstack sudo[92532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD
Sep 25 18:29:36 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:36 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1215920300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b081b92-78c8-4231-af15-9acf1b0c62fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa4cdd347dd4847add737518848e4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:34Z,use_quota=True,user_id='222f46f73db34a1f9cedce0e424c1f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Creating volume 5b081b92-78c8-4231-af15-9acf1b0c62fa {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:36 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:36 devstack sudo[92537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa 1073741824
Sep 25 18:29:36 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:37 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa 1073741824" returned: 0 in 0.591s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:37 devstack sudo[92543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa
Sep 25 18:29:37 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:37 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Attempting download of 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 5b081b92-78c8-4231-af15-9acf1b0c62fa. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5dc935-3c42-4c95-a4a5-432812975574]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:37 devstack sudo[92546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp
Sep 25 18:29:37 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:38 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp" returned: 0 in 0.458s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:38 devstack sudo[92550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp
Sep 25 18:29:38 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:38 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp" returned: 1 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_o68o4uxp' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3c1a6-fc40-4e1c-8538-54a835093e0a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:38 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD
Sep 25 18:29:38 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:38 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 was qcow2, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:29:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:38 devstack sudo[92566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa
Sep 25 18:29:38 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:41 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa" returned: 0 in 2.650s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_p3t4s2xfdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:29:41 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Converted 112.00 MB image at 42.24 MB/s
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:41 devstack sudo[92578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa 1G
Sep 25 18:29:41 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:41 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa 1G" returned: 0 in 0.508s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Downloaded image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 5b081b92-78c8-4231-af15-9acf1b0c62fa successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 for user 222f46f73db34a1f9cedce0e424c1f2b is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:29:41 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Marking volume 5b081b92-78c8-4231-af15-9acf1b0c62fa as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:29:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Copying metadata from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 to 5b081b92-78c8-4231-af15-9acf1b0c62fa. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:29:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Creating volume glance metadata for volume 5b081b92-78c8-4231-af15-9acf1b0c62fa backed by image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:29:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4b4a4d-99d2-4d45-b3e9-2ff63e6cc07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b081b92-78c8-4231-af15-9acf1b0c62fa', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7ebe210>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39f8fd6-8a30-4c36-b061-db9259a3c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Volume volume-5b081b92-78c8-4231-af15-9acf1b0c62fa (5b081b92-78c8-4231-af15-9acf1b0c62fa): created successfully
Sep 25 18:29:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39f8fd6-8a30-4c36-b061-db9259a3c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Flow 'volume_create_manager' (f4110685-1b06-452e-a98d-5df488f2e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b2c894d4-cf51-4943-9eb5-f87267dafa25 tempest-ServerActionsTestOtherA-1239874874 None] Created volume successfully.
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:44 devstack sudo[92600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:29:44 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:44 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.345s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:29:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:29:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=164,cinder:INSERT=44,cinder:UPDATE=151,cinder:DELETE=5 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:29:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=161,cinder:SELECT=182,cinder:INSERT=36,cinder:DELETE=3 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:29:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-a8cc6457-008e-470f-b9e9-d11ce1053a5a req-4cc66f40-57c6-4b2e-9daa-8287c1d8349e tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-a8cc6457-008e-470f-b9e9-d11ce1053a5a req-4cc66f40-57c6-4b2e-9daa-8287c1d8349e tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-a8cc6457-008e-470f-b9e9-d11ce1053a5a req-4cc66f40-57c6-4b2e-9daa-8287c1d8349e tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-a8cc6457-008e-470f-b9e9-d11ce1053a5a req-4cc66f40-57c6-4b2e-9daa-8287c1d8349e tempest-ServerActionsTestOtherA-1239874874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-5b081b92-78c8-4231-af15-9acf1b0c62fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02fcbb1b-cff9-4a03-a610-0c7a4a204583', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:29:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-a8cc6457-008e-470f-b9e9-d11ce1053a5a req-4cc66f40-57c6-4b2e-9daa-8287c1d8349e tempest-ServerActionsTestOtherA-1239874874 None] attachment_update completed successfully.
Sep 25 18:29:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0797bf51-afe8-4eef-9cef-20903a0541c7 tempest-GroupsV314Test-411142121 None] Group tempest-GroupsV314Test-Group-51777826: creating
Sep 25 18:29:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0797bf51-afe8-4eef-9cef-20903a0541c7 tempest-GroupsV314Test-411142121 None] Group tempest-GroupsV314Test-Group-51777826: created successfully
Sep 25 18:29:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0797bf51-afe8-4eef-9cef-20903a0541c7 tempest-GroupsV314Test-411142121 None] Create group completed successfully.
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Flow 'volume_create_manager' (cfeb2d46-4b70-42a0-8c63-bff9194dc902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcee0853-fdab-4143-a32f-3ccf485f6a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcee0853-fdab-4143-a32f-3ccf485f6a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1572765726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d18df9c-cf41-493a-9ae7-fe88f1bea654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96600e0cf7ad425fb03d26e59081c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:59Z,use_quota=True,user_id='3b5e92b781464ae6b45b0bd5110e4063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd76842-98df-48dc-88ab-a05b9221b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd76842-98df-48dc-88ab-a05b9221b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9958c54-67e1-4a67-972e-414493b354ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9958c54-67e1-4a67-972e-414493b354ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d18df9c-cf41-493a-9ae7-fe88f1bea654', 'volume_name': 'volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22546e2-41cb-438b-8fd7-e2dce8e2bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22546e2-41cb-438b-8fd7-e2dce8e2bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3692d91c-4815-44b4-a9c3-78343507e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:58 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Volume 7d18df9c-cf41-493a-9ae7-fe88f1bea654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654', 'volume_size': 1}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1572765726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d18df9c-cf41-493a-9ae7-fe88f1bea654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96600e0cf7ad425fb03d26e59081c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:29:59Z,use_quota=True,user_id='3b5e92b781464ae6b45b0bd5110e4063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Creating volume 7d18df9c-cf41-493a-9ae7-fe88f1bea654 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:29:58 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:29:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:29:58 devstack sudo[92765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 1073741824
Sep 25 18:29:58 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Flow 'volume_create_manager' (8f54f484-8449-4587-becc-7b5cdda68e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31a9944-6b37-400a-ab2e-00132cabda9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31a9944-6b37-400a-ab2e-00132cabda9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-699941192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=73680ef0-5afb-4fa8-8900-540a1549d15b,host='devstack@QuobyteHD#QuobyteHD',id=76bf2782-15dd-4fb6-89af-9f029956b370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5621f5fb354588b90956863ec59852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:00Z,use_quota=True,user_id='c6d4e6f6d34d47f380912303cb5d93d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86fa547b-2999-4911-9bcc-db3ff5f8c7f7),volume_type_id=86fa547b-2999-4911-9bcc-db3ff5f8c7f7)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6856029-8ce7-4b92-bed4-22bd7cfa9ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6856029-8ce7-4b92-bed4-22bd7cfa9ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fefb0c4-4256-4e8c-ad25-d72fe6b52a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fefb0c4-4256-4e8c-ad25-d72fe6b52a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bf2782-15dd-4fb6-89af-9f029956b370', 'volume_name': 'volume-76bf2782-15dd-4fb6-89af-9f029956b370', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c791fffb-3a39-45aa-985d-12961a2bb904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c791fffb-3a39-45aa-985d-12961a2bb904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80616092-92b5-4216-bbe9-1152b06bf382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:29:59 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Volume 76bf2782-15dd-4fb6-89af-9f029956b370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bf2782-15dd-4fb6-89af-9f029956b370', 'volume_size': 1}
Sep 25 18:29:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:00 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 1073741824" returned: 0 in 1.276s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:00 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654
Sep 25 18:30:00 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:00 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654" returned: 0 in 0.452s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=73680ef0-5afb-4fa8-8900-540a1549d15b,created_at=2026-09-25T16:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-699941192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=73680ef0-5afb-4fa8-8900-540a1549d15b,host='devstack@QuobyteHD#QuobyteHD',id=76bf2782-15dd-4fb6-89af-9f029956b370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5621f5fb354588b90956863ec59852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:00Z,use_quota=True,user_id='c6d4e6f6d34d47f380912303cb5d93d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86fa547b-2999-4911-9bcc-db3ff5f8c7f7),volume_type_id=86fa547b-2999-4911-9bcc-db3ff5f8c7f7)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Creating volume 76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:30:00 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3692d91c-4815-44b4-a9c3-78343507e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:00 devstack sudo[92775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 1073741824
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa773a62-08d7-4951-9cdf-1837542a95b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:00 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:00 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Volume volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 (7d18df9c-cf41-493a-9ae7-fe88f1bea654): created successfully
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa773a62-08d7-4951-9cdf-1837542a95b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Flow 'volume_create_manager' (cfeb2d46-4b70-42a0-8c63-bff9194dc902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-26038d5e-d9d0-4197-b8a6-e21e15d67b8f tempest-VolumeQuotasAdminTestJSON-1032098959 None] Created volume successfully.
Sep 25 18:30:01 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 1073741824" returned: 0 in 0.746s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:01 devstack sudo[92824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370
Sep 25 18:30:01 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:02 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370" returned: 0 in 0.654s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80616092-92b5-4216-bbe9-1152b06bf382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bf2782-15dd-4fb6-89af-9f029956b370', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233ec605-ec41-4548-8277-84af489c92a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:02 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Volume volume-76bf2782-15dd-4fb6-89af-9f029956b370 (76bf2782-15dd-4fb6-89af-9f029956b370): created successfully
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233ec605-ec41-4548-8277-84af489c92a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Flow 'volume_create_manager' (8f54f484-8449-4587-becc-7b5cdda68e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "cinder-7d18df9c-cf41-493a-9ae7-fe88f1bea654-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:02 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c11b57d5-addd-497b-ac28-aa9659abbfa9 tempest-GroupsV314Test-411142121 None] Created volume successfully.
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "cinder-7d18df9c-cf41-493a-9ae7-fe88f1bea654-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "cinder-quobyte-7d18df9c-cf41-493a-9ae7-fe88f1bea654" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "cinder-quobyte-7d18df9c-cf41-493a-9ae7-fe88f1bea654" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc9750-9a3c-468c-91a8-fb9faf9e2d34]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:02 devstack sudo[92828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654
Sep 25 18:30:02 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:02 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654" returned: 0 in 0.461s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:02 devstack sudo[92833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654
Sep 25 18:30:02 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:03 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d18df9c-cf41-493a-9ae7-fe88f1bea654" returned: 0 in 0.322s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "cinder-quobyte-7d18df9c-cf41-493a-9ae7-fe88f1bea654" released by "delete_volume" :: held 0.840s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Created reservations ['f8561643-1664-4fc1-80ac-32db19f4f8c5', 'b78478d1-2a40-43ef-91a1-15583234ddc6', '9adeaf5b-b43a-4914-94af-e2ca84b51c0f', 'c5245572-8e94-4335-b9ce-c64cf21a65ec'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:03 devstack sudo[92839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:03 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:04 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.833s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Deleted volume successfully.
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0492916b-f663-4f63-a4f3-d4c9d94d3885 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "cinder-7d18df9c-cf41-493a-9ae7-fe88f1bea654-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Flow 'volume_create_manager' (b5693071-721f-446c-8c08-f665bf35a2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344b79aa-16cf-408a-a1fb-118aafe956e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344b79aa-16cf-408a-a1fb-118aafe956e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1433638311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd6194f-cd23-4852-b110-3d8045bde80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96600e0cf7ad425fb03d26e59081c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:05Z,use_quota=True,user_id='3b5e92b781464ae6b45b0bd5110e4063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea28367-21f2-4624-8592-ec2cc3573479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea28367-21f2-4624-8592-ec2cc3573479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed334c6f-0c52-4966-9938-74a2fd7d8a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed334c6f-0c52-4966-9938-74a2fd7d8a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd6194f-cd23-4852-b110-3d8045bde80a', 'volume_name': 'volume-2cd6194f-cd23-4852-b110-3d8045bde80a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aaadce-50c0-4899-baaa-2f5a5264f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2aaadce-50c0-4899-baaa-2f5a5264f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1498d37e-5531-4efb-82d8-cc271cd4f83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:04 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Volume 2cd6194f-cd23-4852-b110-3d8045bde80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd6194f-cd23-4852-b110-3d8045bde80a', 'volume_size': 1}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1433638311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd6194f-cd23-4852-b110-3d8045bde80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96600e0cf7ad425fb03d26e59081c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:05Z,use_quota=True,user_id='3b5e92b781464ae6b45b0bd5110e4063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Creating volume 2cd6194f-cd23-4852-b110-3d8045bde80a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:30:04 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:04 devstack sudo[92855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a 1073741824
Sep 25 18:30:04 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:05 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a 1073741824" returned: 0 in 0.731s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:05 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a
Sep 25 18:30:05 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:06 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a" returned: 0 in 0.346s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.112s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:06 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Cloning volume 76bf2782-15dd-4fb6-89af-9f029956b370 to volume a0fec42b-9b23-4501-9f41-89b5daa9f512
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1498d37e-5531-4efb-82d8-cc271cd4f83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd6194f-cd23-4852-b110-3d8045bde80a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce7fe91-8c07-40bd-bafb-2090014663a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Creating offline snapshot 40cdf14a-cf24-4443-8e55-c8a882d1473e of volume 76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:30:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Volume volume-2cd6194f-cd23-4852-b110-3d8045bde80a (2cd6194f-cd23-4852-b110-3d8045bde80a): created successfully
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce7fe91-8c07-40bd-bafb-2090014663a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Flow 'volume_create_manager' (b5693071-721f-446c-8c08-f665bf35a2e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[31810b34-9b80-4d82-9e45-ad1f6bd91ddc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7856335b-5a21-4a76-bf47-265ff1e11655 tempest-VolumeQuotasAdminTestJSON-1032098959 None] Created volume successfully.
Sep 25 18:30:06 devstack sudo[92879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370
Sep 25 18:30:06 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:06 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370" returned: 0 in 0.474s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:06 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e 1G
Sep 25 18:30:06 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:07 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e 1G" returned: 0 in 0.531s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bf2782-15dd-4fb6-89af-9f029956b370 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:07 devstack sudo[92892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bf2782-15dd-4fb6-89af-9f029956b370 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e
Sep 25 18:30:07 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:07 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76bf2782-15dd-4fb6-89af-9f029956b370 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e" returned: 0 in 0.539s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:07 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:30:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:07 devstack sudo[92916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e
Sep 25 18:30:07 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-1e7839a7-f84d-40be-aedc-c28e88f168cc tempest-ServerActionsTestOtherA-1239874874 None] Terminate volume connection completed successfully.
Sep 25 18:30:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-1e7839a7-f84d-40be-aedc-c28e88f168cc tempest-ServerActionsTestOtherA-1239874874 None] Deleting attachment 02fcbb1b-cff9-4a03-a610-0c7a4a204583. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:30:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ae0a4406-ec8f-4cc9-b942-3d13d524c705 tempest-VolumeQuotasAdminTestJSON-1172840691 None] Transfer volume completed successfully.
Sep 25 18:30:08 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e" returned: 0 in 0.548s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:08 devstack sudo[92924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info
Sep 25 18:30:08 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:08 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info" returned: 0 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:08 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:30:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:08 devstack sudo[92929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info
Sep 25 18:30:08 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Acquiring lock "cinder-2cd6194f-cd23-4852-b110-3d8045bde80a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Lock "cinder-2cd6194f-cd23-4852-b110-3d8045bde80a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Acquiring lock "cinder-quobyte-2cd6194f-cd23-4852-b110-3d8045bde80a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Lock "cinder-quobyte-2cd6194f-cd23-4852-b110-3d8045bde80a" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8cdd0-013e-4a3b-b161-58bcfe43b59f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:09 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.info" returned: 0 in 0.457s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Acquiring lock "cinder-quobyte-a0fec42b-9b23-4501-9f41-89b5daa9f512" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-a0fec42b-9b23-4501-9f41-89b5daa9f512" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] snapshot: 40cdf14a-cf24-4443-8e55-c8a882d1473e, volume: a0fec42b-9b23-4501-9f41-89b5daa9f512,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32bc79e-e48d-4768-afa6-8f165a7d29c9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:09 devstack sudo[92932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a
Sep 25 18:30:09 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:09 devstack sudo[92934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e
Sep 25 18:30:09 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:09 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a" returned: 0 in 0.467s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:09 devstack sudo[92940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a
Sep 25 18:30:09 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:09 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e" returned: 0 in 0.604s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76bf2782-15dd-4fb6-89af-9f029956b370(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b65be61-af46-4db9-80e8-0cba2e91833f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:09 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2cd6194f-cd23-4852-b110-3d8045bde80a" returned: 0 in 0.361s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Lock "cinder-quobyte-2cd6194f-cd23-4852-b110-3d8045bde80a" released by "delete_volume" :: held 0.879s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:10 devstack sudo[92950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370
Sep 25 18:30:10 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Created reservations ['96e288b2-2450-41cf-949f-4751fc57d14f', 'c974a2a1-a006-42a1-9a1c-0a032510c613', '210c8361-77af-4301-a58f-b40736d1c04c', 'b7643bb6-8022-4487-952c-744d4f58cec6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-67067888-e86e-44e8-bb00-664486980418 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:10 devstack sudo[92956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:10 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:10 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370" returned: 0 in 0.467s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:10 devstack sudo[92961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512
Sep 25 18:30:10 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:10 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Deleted volume successfully.
Sep 25 18:30:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-591c0e8f-244e-40ad-a6b6-f76c39da561d tempest-VolumeQuotasAdminTestJSON-1124625005 None] Lock "cinder-2cd6194f-cd23-4852-b110-3d8045bde80a-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:19 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512" returned: 0 in 8.753s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:30:19 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Converted 1024.00 MB image at 116.97 MB/s
Sep 25 18:30:19 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:19 devstack sudo[93010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512
Sep 25 18:30:19 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:19 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512" returned: 0 in 0.300s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-a0fec42b-9b23-4501-9f41-89b5daa9f512" released by "_copy_volume_from_snapshot" :: held 10.229s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Acquiring lock "cinder-quobyte-40cdf14a-cf24-4443-8e55-c8a882d1473e" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-40cdf14a-cf24-4443-8e55-c8a882d1473e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Deleting offline snapshot 40cdf14a-cf24-4443-8e55-c8a882d1473e of volume 76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] snapshot_file for this snap is: volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e191f3-0f56-4085-bff3-f8c555d8b5b0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:19 devstack sudo[93014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e
Sep 25 18:30:19 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:19 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76bf2782-15dd-4fb6-89af-9f029956b370(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3883c0df-60cd-4efc-a7d7-8be507a6c6bf]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:20 devstack sudo[93019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370
Sep 25 18:30:20 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:20 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=31,cinder:SELECT=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:30:20 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370" returned: 0 in 0.660s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:20 devstack sudo[93024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e
Sep 25 18:30:20 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:20 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:21 devstack sudo[93030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e
Sep 25 18:30:21 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:21 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370.40cdf14a-cf24-4443-8e55-c8a882d1473e" returned: 0 in 0.284s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-40cdf14a-cf24-4443-8e55-c8a882d1473e" released by "_delete_snapshot" :: held 1.836s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.308s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-67067888-e86e-44e8-bb00-664486980418 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.211s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-67067888-e86e-44e8-bb00-664486980418 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-67067888-e86e-44e8-bb00-664486980418 tempest-ServerActionsTestOtherA-1239874874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-5b081b92-78c8-4231-af15-9acf1b0c62fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bd5f7b7-75de-434f-9a9d-d60b660b41ff', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:30:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-57d82f76-e5a3-4b7f-8d6e-cf48d5a4d0bb tempest-GroupsV314Test-411142121 None] Create group from source-group-73680ef0-5afb-4fa8-8900-540a1549d15b completed successfully.
Sep 25 18:30:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-0f612ad6-892b-4b0f-bbca-d38ecf7e85a3 req-67067888-e86e-44e8-bb00-664486980418 tempest-ServerActionsTestOtherA-1239874874 None] attachment_update completed successfully.
Sep 25 18:30:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Acquiring lock "cinder-quobyte-a0fec42b-9b23-4501-9f41-89b5daa9f512" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-a0fec42b-9b23-4501-9f41-89b5daa9f512" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5604cd6-44a6-4381-b32b-e846d38ffcec]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:22 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512
Sep 25 18:30:22 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Flow 'volume_create_manager' (a6ebf712-7ecf-44b2-ad8a-c6484cc0570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb7f1f-c2ef-4d2a-9d65-3e9a8b60c015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb7f1f-c2ef-4d2a-9d65-3e9a8b60c015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2012803951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cce99cb-5fae-422e-8eff-708263905493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b008cd06a48769e58f9d50b0c2dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:23Z,use_quota=True,user_id='7f9cc0b9af8f425eb29e05f7baea7da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a45b93e8-a23a-4144-ae37-ab701d854a93),volume_type_id=a45b93e8-a23a-4144-ae37-ab701d854a93)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:23 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b70df0-0c16-4217-b317-8e0ff3130526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b70df0-0c16-4217-b317-8e0ff3130526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4551a57d-6d0b-4bdd-862b-6899b63e86a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4551a57d-6d0b-4bdd-862b-6899b63e86a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cce99cb-5fae-422e-8eff-708263905493', 'volume_name': 'volume-4cce99cb-5fae-422e-8eff-708263905493', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc01516-ee2b-49e7-8f8d-3a56e74a245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc01516-ee2b-49e7-8f8d-3a56e74a245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792adfc7-bd50-4c8e-a126-40f4916748ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:23 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Volume 4cce99cb-5fae-422e-8eff-708263905493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cce99cb-5fae-422e-8eff-708263905493', 'volume_size': 1}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2012803951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cce99cb-5fae-422e-8eff-708263905493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b008cd06a48769e58f9d50b0c2dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:23Z,use_quota=True,user_id='7f9cc0b9af8f425eb29e05f7baea7da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a45b93e8-a23a-4144-ae37-ab701d854a93),volume_type_id=a45b93e8-a23a-4144-ae37-ab701d854a93)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Creating volume 4cce99cb-5fae-422e-8eff-708263905493 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:30:23 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512" returned: 0 in 0.767s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:23 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493 1073741824
Sep 25 18:30:23 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:23 devstack sudo[93114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512
Sep 25 18:30:23 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-e8ef20fd-58c6-48f5-86c5-1df3cb93910d req-91e212cf-34d5-4e87-94a0-43fbcaf658fc tempest-AttachVolumeNegativeTest-1017368670 None] Terminate volume connection completed successfully.
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-e8ef20fd-58c6-48f5-86c5-1df3cb93910d req-91e212cf-34d5-4e87-94a0-43fbcaf658fc tempest-AttachVolumeNegativeTest-1017368670 None] Deleting attachment 1e248e10-a83a-45ea-aab1-eeddf6c841f1. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:30:23 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a0fec42b-9b23-4501-9f41-89b5daa9f512" returned: 0 in 0.333s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-a0fec42b-9b23-4501-9f41-89b5daa9f512" released by "delete_volume" :: held 1.169s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Created reservations ['1fcd3659-41ee-4d1e-95f0-e50693f464a3'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:23 devstack cinder-volume[86534]: WARNING cinder.quota [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-994810188 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-994810188, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:30:23 devstack cinder-volume[86534]: WARNING cinder.quota [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-994810188 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-994810188, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Created reservations ['f22d610a-00fb-4ff5-9b7f-4ba4f7802237', '6e284e6a-dd53-4fde-a07e-09e40d333c14', 'c562707e-53fc-449f-a749-8d1ea8f3d7d0', '7c73fc4a-b97c-4cea-992a-84a374e9cd73'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:23 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493 1073741824" returned: 0 in 0.593s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:23 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493
Sep 25 18:30:23 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:24 devstack sudo[93140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:24 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:24 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493" returned: 0 in 0.409s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:24 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792adfc7-bd50-4c8e-a126-40f4916748ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cce99cb-5fae-422e-8eff-708263905493', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f51c9ae-0a03-41f5-891a-78a9ba9b0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-70564193-2440-4ed8-a297-460851e9ae65 tempest-GroupsV314Test-411142121 None] Delete group completed successfully.
Sep 25 18:30:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Volume volume-4cce99cb-5fae-422e-8eff-708263905493 (4cce99cb-5fae-422e-8eff-708263905493): created successfully
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f51c9ae-0a03-41f5-891a-78a9ba9b0390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Flow 'volume_create_manager' (a6ebf712-7ecf-44b2-ad8a-c6484cc0570c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-92fb469d-e16e-4fe5-ba86-0b3fa2ecfcb4 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Created volume successfully.
Sep 25 18:30:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Acquiring lock "cinder-quobyte-76bf2782-15dd-4fb6-89af-9f029956b370" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-76bf2782-15dd-4fb6-89af-9f029956b370" acquired by "delete_volume" :: waited 0.039s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e02417-28c7-430b-bfea-3ef2a0a10dc6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:25 devstack sudo[93175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370
Sep 25 18:30:25 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:26 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370" returned: 0 in 0.814s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:26 devstack sudo[93181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:26 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:26 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370
Sep 25 18:30:26 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:26 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76bf2782-15dd-4fb6-89af-9f029956b370" returned: 0 in 0.367s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:26 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.434s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1c0f943f-7dd2-45a1-9017-6491692a6332 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Retype volume completed successfully.
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Lock "cinder-quobyte-76bf2782-15dd-4fb6-89af-9f029956b370" released by "delete_volume" :: held 1.355s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Created reservations ['6a2ff2ea-e93f-42d2-a715-e0dd9efda408'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:26 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Created reservations ['2e4bc3a1-1e06-4890-b5f2-374b03f220c7', '173ecd41-814e-42dd-9448-cbaf0fa99b04', '14540572-c88f-4909-8b5e-afc21e68e3f6', '6e17cfe3-e65c-4ae7-bc05-ee5a382f0d01'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:27 devstack sudo[93189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:27 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:27 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.541s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3c79b957-98d4-4c35-8c37-a9c691567646 tempest-GroupsV314Test-411142121 None] Delete group completed successfully.
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Acquiring lock "cinder-4cce99cb-5fae-422e-8eff-708263905493-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "cinder-4cce99cb-5fae-422e-8eff-708263905493-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Acquiring lock "cinder-quobyte-4cce99cb-5fae-422e-8eff-708263905493" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "cinder-quobyte-4cce99cb-5fae-422e-8eff-708263905493" acquired by "delete_volume" :: waited 0.040s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f232f75e-ebde-463b-bd71-02789ba698c0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:28 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493
Sep 25 18:30:28 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:28 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493" returned: 0 in 0.810s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:28 devstack sudo[93200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493
Sep 25 18:30:28 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:29 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4cce99cb-5fae-422e-8eff-708263905493" returned: 0 in 0.507s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "cinder-quobyte-4cce99cb-5fae-422e-8eff-708263905493" released by "delete_volume" :: held 1.435s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:29 devstack cinder-volume[86534]: WARNING cinder.quota [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:30:29 devstack cinder-volume[86534]: WARNING cinder.quota [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Created reservations ['45995063-b93d-4378-9b02-4a3ab19f840d', 'ded5186f-7b74-4064-bec0-b7492112de3d', 'aced4538-b88f-423c-8c95-8dcba2149484', 'dd0a5b55-df7a-4a4f-9bac-5c9177e9449c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:29 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:29 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:29 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.472s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:30 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Deleted volume successfully.
Sep 25 18:30:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7465785-7880-4fcd-a2bb-a8db538dc4a2 tempest-VolumeRetypeWithoutMigrationTest-172344957 None] Lock "cinder-4cce99cb-5fae-422e-8eff-708263905493-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6cd78db9-4576-4c03-9512-e17630fa8d0b tempest-GroupsV320Test-1378417481 None] Group tempest-GroupsV320Test-Group-589042928: creating
Sep 25 18:30:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6cd78db9-4576-4c03-9512-e17630fa8d0b tempest-GroupsV320Test-1378417481 None] Group tempest-GroupsV320Test-Group-589042928: created successfully
Sep 25 18:30:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6cd78db9-4576-4c03-9512-e17630fa8d0b tempest-GroupsV320Test-1378417481 None] Create group completed successfully.
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Created reservations ['54b8965e-23ab-4a00-987c-4dafafe79c79'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:40 devstack sudo[93237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:40 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:40 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.430s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:40 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-98821096-c71f-466b-b535-d55e895075ef tempest-GroupsV320Test-1378417481 None] Delete group completed successfully.
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:44 devstack sudo[93338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:44 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:44 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.515s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:30:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:30:50 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=49,cinder:SELECT=42,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:30:50 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=81,cinder:UPDATE=66,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:30:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-14cb273d-2422-463d-8f5f-91f54476bafe req-beb443f5-4b5f-4f8d-a82d-2c9dbe94b3ff tempest-ServerActionsTestOtherA-1239874874 None] Terminate volume connection completed successfully.
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-14cb273d-2422-463d-8f5f-91f54476bafe req-beb443f5-4b5f-4f8d-a82d-2c9dbe94b3ff tempest-ServerActionsTestOtherA-1239874874 None] Deleting attachment 2bd5f7b7-75de-434f-9a9d-d60b660b41ff. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "cinder-5b081b92-78c8-4231-af15-9acf1b0c62fa-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-5b081b92-78c8-4231-af15-9acf1b0c62fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "cinder-quobyte-5b081b92-78c8-4231-af15-9acf1b0c62fa" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-quobyte-5b081b92-78c8-4231-af15-9acf1b0c62fa" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f55088-2e55-42e9-9454-1dfea8b041e9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:58 devstack sudo[93406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa
Sep 25 18:30:58 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:58 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa" returned: 0 in 0.484s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:58 devstack sudo[93413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa
Sep 25 18:30:58 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:58 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5b081b92-78c8-4231-af15-9acf1b0c62fa" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-quobyte-5b081b92-78c8-4231-af15-9acf1b0c62fa" released by "delete_volume" :: held 0.846s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.quota [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Created reservations ['f5315f01-9f1d-444b-bdcd-3f4468caf80d', '078ceb4a-d03a-4997-9727-4a21c428f542', 'd34a4132-e39f-48dd-9e13-649c82b837d0', 'a07bbc65-b1de-475c-a820-b303e08a2c99'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:58 devstack sudo[93417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:30:58 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Flow 'volume_create_manager' (e879c4ae-d9d0-46cb-80ef-534e537918f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee46d4d-fe4b-4e4c-b388-4acea2a967aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee46d4d-fe4b-4e4c-b388-4acea2a967aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-554299085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16561774-252a-4a28-aa02-c2c9a0938eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25b0b5271a0407292b3bda0c7df6028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:59Z,use_quota=True,user_id='0efefc6bc8b1424ab3382ad419bd596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a50394-012b-408a-8293-a3ca076defef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a50394-012b-408a-8293-a3ca076defef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be74b5f-c800-41ad-9384-2bc191e0372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be74b5f-c800-41ad-9384-2bc191e0372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16561774-252a-4a28-aa02-c2c9a0938eaf', 'volume_name': 'volume-16561774-252a-4a28-aa02-c2c9a0938eaf', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f11a9f-9d74-4393-9c76-51c5efe6d231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f11a9f-9d74-4393-9c76-51c5efe6d231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f48a8a-e94a-449e-ac8c-ba42479c4a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:59 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Volume 16561774-252a-4a28-aa02-c2c9a0938eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16561774-252a-4a28-aa02-c2c9a0938eaf', 'volume_size': 1}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-554299085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16561774-252a-4a28-aa02-c2c9a0938eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25b0b5271a0407292b3bda0c7df6028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:30:59Z,use_quota=True,user_id='0efefc6bc8b1424ab3382ad419bd596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Creating volume 16561774-252a-4a28-aa02-c2c9a0938eaf {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:30:59 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:59 devstack sudo[93419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf 1073741824
Sep 25 18:30:59 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:59 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.332s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.manager [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:30:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Deleted volume successfully.
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-14cb273d-2422-463d-8f5f-91f54476bafe req-866f31e3-1ef6-4f45-b2f1-6fd1589fdd99 tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-5b081b92-78c8-4231-af15-9acf1b0c62fa-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "cinder-38d72e84-0956-4d6e-b6f3-bb6834d1b20b-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-38d72e84-0956-4d6e-b6f3-bb6834d1b20b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "cinder-quobyte-38d72e84-0956-4d6e-b6f3-bb6834d1b20b" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-quobyte-38d72e84-0956-4d6e-b6f3-bb6834d1b20b" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cce672-c833-4098-ac3e-3d9b7ec8fa55]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:59 devstack sudo[93426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b
Sep 25 18:30:59 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:59 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf 1073741824" returned: 0 in 0.511s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:59 devstack sudo[93428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf
Sep 25 18:30:59 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:59 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b" returned: 0 in 0.424s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:30:59 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:30:59 devstack sudo[93434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:30:59 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f48a8a-e94a-449e-ac8c-ba42479c4a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16561774-252a-4a28-aa02-c2c9a0938eaf', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f852ca2-bae6-4bc4-9fcf-d51ce8806824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:30:59 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Volume volume-16561774-252a-4a28-aa02-c2c9a0938eaf (16561774-252a-4a28-aa02-c2c9a0938eaf): created successfully
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f852ca2-bae6-4bc4-9fcf-d51ce8806824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:30:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Flow 'volume_create_manager' (e879c4ae-d9d0-46cb-80ef-534e537918f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:30:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6a76da8d-4c4f-43bb-b47f-2727a07a126f tempest-VolumesListAdminTestJSON-1058570176 None] Created volume successfully.
Sep 25 18:31:00 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-38d72e84-0956-4d6e-b6f3-bb6834d1b20b" returned: 0 in 0.295s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-quobyte-38d72e84-0956-4d6e-b6f3-bb6834d1b20b" released by "delete_volume" :: held 0.763s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Created reservations ['570e2938-d1c9-4bfe-9172-898af79ed39f', '75cf8888-2c25-4590-8e79-0d5f8ab22ee3', 'df051927-7371-4beb-b496-2fa6219ddbe5', '53dc1ec4-a27b-4a4e-a843-0712e3acd9d6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:00 devstack sudo[93437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:00 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:00 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Deleted volume successfully.
Sep 25 18:31:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c1cefd97-07a6-4b5a-8b27-fb1777c8708c tempest-ServerActionsTestOtherA-1239874874 None] Lock "cinder-38d72e84-0956-4d6e-b6f3-bb6834d1b20b-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Flow 'volume_create_manager' (70c2a93d-2002-4f91-8c1e-ea1b560d6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533c45b6-a008-4f19-98d6-731651284a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533c45b6-a008-4f19-98d6-731651284a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1150541879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577c4b72-8bce-4fbf-9456-476b3364447d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25b0b5271a0407292b3bda0c7df6028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:02Z,use_quota=True,user_id='0efefc6bc8b1424ab3382ad419bd596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bed12b-3f1e-4031-9a98-0acb48992baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bed12b-3f1e-4031-9a98-0acb48992baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c007e49b-26aa-45e5-9739-f921d9dceb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c007e49b-26aa-45e5-9739-f921d9dceb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577c4b72-8bce-4fbf-9456-476b3364447d', 'volume_name': 'volume-577c4b72-8bce-4fbf-9456-476b3364447d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90d2537-fe69-4949-81cb-fc5b0fba7502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90d2537-fe69-4949-81cb-fc5b0fba7502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90753800-63c8-4cb8-8418-2517be791daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:01 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Volume 577c4b72-8bce-4fbf-9456-476b3364447d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577c4b72-8bce-4fbf-9456-476b3364447d', 'volume_size': 1}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1150541879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577c4b72-8bce-4fbf-9456-476b3364447d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25b0b5271a0407292b3bda0c7df6028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:02Z,use_quota=True,user_id='0efefc6bc8b1424ab3382ad419bd596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Creating volume 577c4b72-8bce-4fbf-9456-476b3364447d {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:01 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:02 devstack sudo[93468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d 1073741824
Sep 25 18:31:02 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:02 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d 1073741824" returned: 0 in 0.588s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:02 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d
Sep 25 18:31:02 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:02 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d" returned: 0 in 0.317s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90753800-63c8-4cb8-8418-2517be791daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577c4b72-8bce-4fbf-9456-476b3364447d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267c1c57-48cb-4575-a6b1-a6b65f938f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:02 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Volume volume-577c4b72-8bce-4fbf-9456-476b3364447d (577c4b72-8bce-4fbf-9456-476b3364447d): created successfully
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267c1c57-48cb-4575-a6b1-a6b65f938f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Flow 'volume_create_manager' (70c2a93d-2002-4f91-8c1e-ea1b560d6cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d6f8dc76-4284-4ee9-a890-bc8de8a7feaa tempest-VolumesListAdminTestJSON-1058570176 None] Created volume successfully.
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Flow 'volume_create_manager' (79f06322-cae4-4c3b-a55b-e9c9a6525f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bbe087-6d80-44e4-afcc-8d75c6a582c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bbe087-6d80-44e4-afcc-8d75c6a582c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-413909452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2449d30b-1534-4d9a-90ed-8a18ad059019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25b0b5271a0407292b3bda0c7df6028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:05Z,use_quota=True,user_id='0efefc6bc8b1424ab3382ad419bd596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8635135d-4f89-483f-8479-3e1d26df4e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8635135d-4f89-483f-8479-3e1d26df4e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af405486-ab3e-4d46-ac72-574e515923f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af405486-ab3e-4d46-ac72-574e515923f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2449d30b-1534-4d9a-90ed-8a18ad059019', 'volume_name': 'volume-2449d30b-1534-4d9a-90ed-8a18ad059019', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112d0b1-42ea-4c33-acce-a6c7033586ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c112d0b1-42ea-4c33-acce-a6c7033586ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0072a322-ff5c-4401-91da-2ace33b0f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:04 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Volume 2449d30b-1534-4d9a-90ed-8a18ad059019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2449d30b-1534-4d9a-90ed-8a18ad059019', 'volume_size': 1}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-413909452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2449d30b-1534-4d9a-90ed-8a18ad059019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25b0b5271a0407292b3bda0c7df6028',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:05Z,use_quota=True,user_id='0efefc6bc8b1424ab3382ad419bd596e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Creating volume 2449d30b-1534-4d9a-90ed-8a18ad059019 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:04 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:04 devstack sudo[93489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019 1073741824
Sep 25 18:31:04 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:05 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019 1073741824" returned: 0 in 0.554s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:05 devstack sudo[93495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019
Sep 25 18:31:05 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:05 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019" returned: 0 in 0.292s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0072a322-ff5c-4401-91da-2ace33b0f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2449d30b-1534-4d9a-90ed-8a18ad059019', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dca01e4-29c0-4ded-8f4b-7df0d91e9f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:05 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Volume volume-2449d30b-1534-4d9a-90ed-8a18ad059019 (2449d30b-1534-4d9a-90ed-8a18ad059019): created successfully
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dca01e4-29c0-4ded-8f4b-7df0d91e9f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Flow 'volume_create_manager' (79f06322-cae4-4c3b-a55b-e9c9a6525f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e532f725-4121-408d-9c86-3c55a4bfb5a9 tempest-VolumesListAdminTestJSON-1058570176 None] Created volume successfully.
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Flow 'volume_create_manager' (995ce39d-3ca2-41c7-9156-edd31118acc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d3d741-0ba3-459e-90d6-a35eefe7787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d3d741-0ba3-459e-90d6-a35eefe7787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe06dcb-9395-4a01-88ad-8358a83b5432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03a8eafd56104d8ea885d5edae1ae008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:08Z,use_quota=True,user_id='a1d96b86ed0a434d889d318b7c289a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e19fd4-4daa-4e4a-9dd9-1cb63c01970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e19fd4-4daa-4e4a-9dd9-1cb63c01970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bd0eca-4fa6-4fa6-814a-b984093565ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bd0eca-4fa6-4fa6-814a-b984093565ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe06dcb-9395-4a01-88ad-8358a83b5432', 'volume_name': 'volume-3fe06dcb-9395-4a01-88ad-8358a83b5432', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdf168e-f21d-44a9-80b3-4adb5d371a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdf168e-f21d-44a9-80b3-4adb5d371a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a26a702-a6d3-4bc8-b480-0c5ce4e8860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Volume 3fe06dcb-9395-4a01-88ad-8358a83b5432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe06dcb-9395-4a01-88ad-8358a83b5432', 'volume_size': 1}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe06dcb-9395-4a01-88ad-8358a83b5432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03a8eafd56104d8ea885d5edae1ae008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:08Z,use_quota=True,user_id='a1d96b86ed0a434d889d318b7c289a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Creating volume 3fe06dcb-9395-4a01-88ad-8358a83b5432 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:07 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:07 devstack sudo[93499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 1073741824
Sep 25 18:31:07 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:08 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 1073741824" returned: 0 in 0.539s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:08 devstack sudo[93507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432
Sep 25 18:31:08 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:08 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432" returned: 0 in 0.434s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a26a702-a6d3-4bc8-b480-0c5ce4e8860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe06dcb-9395-4a01-88ad-8358a83b5432', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f05f93-1828-436a-8a2d-34fe5ac4b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Volume volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 (3fe06dcb-9395-4a01-88ad-8358a83b5432): created successfully
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f05f93-1828-436a-8a2d-34fe5ac4b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Flow 'volume_create_manager' (995ce39d-3ca2-41c7-9156-edd31118acc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-dda3ccc6-3a2a-4fb0-85fa-cbbe36b2742d tempest-VolumesListAdminTestJSON-704242303 None] Created volume successfully.
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Flow 'volume_create_manager' (b1decdbd-9aa2-43e6-896c-201bb5cabbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb31ef1-312a-417a-974c-126be52f691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb31ef1-312a-417a-974c-126be52f691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257897602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c726c4-e529-4df0-8b7d-6e1d979b9bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8152040b0f0c46b494b2f3cb2114116b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:09Z,use_quota=True,user_id='b35681d92c884bc2bc4e5baa14e9c336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a366606-ad91-4820-a221-23f271e64b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a366606-ad91-4820-a221-23f271e64b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f8a5c5-468e-4cff-81d6-ee2af2f0a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f8a5c5-468e-4cff-81d6-ee2af2f0a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c726c4-e529-4df0-8b7d-6e1d979b9bcc', 'volume_name': 'volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b0ae95-a1aa-4db1-b1e4-36c0fb514021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b0ae95-a1aa-4db1-b1e4-36c0fb514021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b3c8b6-be20-4efa-8193-00a9c5e1c272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Volume 11c726c4-e529-4df0-8b7d-6e1d979b9bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc', 'volume_size': 1}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257897602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c726c4-e529-4df0-8b7d-6e1d979b9bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8152040b0f0c46b494b2f3cb2114116b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:09Z,use_quota=True,user_id='b35681d92c884bc2bc4e5baa14e9c336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Creating volume 11c726c4-e529-4df0-8b7d-6e1d979b9bcc {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:08 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:08 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc 1073741824
Sep 25 18:31:08 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:09 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc 1073741824" returned: 0 in 0.535s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:09 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc
Sep 25 18:31:09 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:09 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc" returned: 0 in 0.330s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b3c8b6-be20-4efa-8193-00a9c5e1c272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23de7883-bb9d-411e-a179-09c598c8a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Acquiring lock "cinder-3fe06dcb-9395-4a01-88ad-8358a83b5432-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:09 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Volume volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc (11c726c4-e529-4df0-8b7d-6e1d979b9bcc): created successfully
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23de7883-bb9d-411e-a179-09c598c8a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Flow 'volume_create_manager' (b1decdbd-9aa2-43e6-896c-201bb5cabbd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Lock "cinder-3fe06dcb-9395-4a01-88ad-8358a83b5432-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-66e3352a-5e63-400d-8b24-cef6a4a82bc9 tempest-AttachVolumeNegativeTest-1017368670 None] Created volume successfully.
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Acquiring lock "cinder-quobyte-3fe06dcb-9395-4a01-88ad-8358a83b5432" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Lock "cinder-quobyte-3fe06dcb-9395-4a01-88ad-8358a83b5432" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b14dad4-4325-4695-aa44-b827cfe746ca]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "cinder-2449d30b-1534-4d9a-90ed-8a18ad059019-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-2449d30b-1534-4d9a-90ed-8a18ad059019-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "cinder-quobyte-2449d30b-1534-4d9a-90ed-8a18ad059019" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-quobyte-2449d30b-1534-4d9a-90ed-8a18ad059019" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00ba83-1915-49a7-a43a-5657f8b0cf6c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:10 devstack sudo[93521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432
Sep 25 18:31:10 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:10 devstack sudo[93523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019
Sep 25 18:31:10 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:10 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432" returned: 0 in 0.534s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:10 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432
Sep 25 18:31:10 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:10 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019" returned: 0 in 0.494s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:10 devstack sudo[93533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019
Sep 25 18:31:10 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:10 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3fe06dcb-9395-4a01-88ad-8358a83b5432" returned: 0 in 0.322s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Lock "cinder-quobyte-3fe06dcb-9395-4a01-88ad-8358a83b5432" released by "delete_volume" :: held 0.935s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Created reservations ['01a845b4-e237-42e3-9e1b-2f92700b201b', '1010465f-73b5-4b8d-9777-aae98daa424e', '9cf92b77-515e-441f-8d9b-2fd7624a9e3b', '4faee1c7-01ba-4eac-874d-1de146ca9190'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:11 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2449d30b-1534-4d9a-90ed-8a18ad059019" returned: 0 in 0.467s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:11 devstack sudo[93541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:11 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-quobyte-2449d30b-1534-4d9a-90ed-8a18ad059019" released by "delete_volume" :: held 1.038s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Created reservations ['92ebba4c-63ef-4596-b515-0d8c7bc82a9e', '445f1612-913c-4c44-9485-18350f2c0a5b', 'e0a50ed5-ae05-47db-a09f-81f42e874515', '0731c407-d1cd-4ffb-845d-8bb9796bff36'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:11 devstack sudo[93543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:11 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:11 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Deleted volume successfully.
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c4c0f85c-aac5-463e-beaa-a8f2250b060c tempest-VolumesListAdminTestJSON-704242303 None] Lock "cinder-3fe06dcb-9395-4a01-88ad-8358a83b5432-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:11 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.433s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:11 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Deleted volume successfully.
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1adf9e3c-24ab-4985-b7f9-6bb2941ad2da tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-2449d30b-1534-4d9a-90ed-8a18ad059019-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-1a05c91c-1876-4442-8c30-cf3c70b2796a req-5f14faa5-2988-41e5-8b72-b28132d23373 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-1a05c91c-1876-4442-8c30-cf3c70b2796a req-5f14faa5-2988-41e5-8b72-b28132d23373 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-1a05c91c-1876-4442-8c30-cf3c70b2796a req-5f14faa5-2988-41e5-8b72-b28132d23373 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-1a05c91c-1876-4442-8c30-cf3c70b2796a req-5f14faa5-2988-41e5-8b72-b28132d23373 tempest-AttachVolumeNegativeTest-1017368670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95033c59-d335-48d7-bf46-bf475563415a', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:31:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-1a05c91c-1876-4442-8c30-cf3c70b2796a req-5f14faa5-2988-41e5-8b72-b28132d23373 tempest-AttachVolumeNegativeTest-1017368670 None] attachment_update completed successfully.
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "cinder-577c4b72-8bce-4fbf-9456-476b3364447d-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-577c4b72-8bce-4fbf-9456-476b3364447d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "cinder-quobyte-577c4b72-8bce-4fbf-9456-476b3364447d" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-quobyte-577c4b72-8bce-4fbf-9456-476b3364447d" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc66cc-fc58-4c7f-b3fb-80939a419ce3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:12 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d
Sep 25 18:31:12 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:13 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d" returned: 0 in 0.594s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:13 devstack sudo[93976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d
Sep 25 18:31:13 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:13 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-577c4b72-8bce-4fbf-9456-476b3364447d" returned: 0 in 0.349s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-quobyte-577c4b72-8bce-4fbf-9456-476b3364447d" released by "delete_volume" :: held 1.007s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Created reservations ['e67205f2-b436-4da3-b59e-daf1f8813684', '8029d2e0-4048-49c4-a16b-fd3d1bb94ba9', '65dd1c67-551c-4a44-8f07-97de0f97e461', 'f25a83d0-ecd7-42ad-b28e-4517edc25861'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:13 devstack sudo[93979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:13 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:14 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.388s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:14 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:14 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Deleted volume successfully.
Sep 25 18:31:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38cbad87-f47e-4462-86e8-2286c7aa986b tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-577c4b72-8bce-4fbf-9456-476b3364447d-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "cinder-16561774-252a-4a28-aa02-c2c9a0938eaf-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-16561774-252a-4a28-aa02-c2c9a0938eaf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "cinder-quobyte-16561774-252a-4a28-aa02-c2c9a0938eaf" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-quobyte-16561774-252a-4a28-aa02-c2c9a0938eaf" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc259700-0dc5-4b1e-b590-fc93f59ab811]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:15 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf
Sep 25 18:31:15 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:15 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-b750600e-1395-4e1a-9bfe-9b667f0beb3f req-db52e809-420f-486c-8fe8-bc07f1d66cc5 tempest-AttachVolumeNegativeTest-1017368670 None] Terminate volume connection completed successfully.
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-b750600e-1395-4e1a-9bfe-9b667f0beb3f req-db52e809-420f-486c-8fe8-bc07f1d66cc5 tempest-AttachVolumeNegativeTest-1017368670 None] Deleting attachment 95033c59-d335-48d7-bf46-bf475563415a. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:31:15 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf" returned: 0 in 0.502s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:15 devstack sudo[94017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf
Sep 25 18:31:15 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:15 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-16561774-252a-4a28-aa02-c2c9a0938eaf" returned: 0 in 0.259s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:15 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-quobyte-16561774-252a-4a28-aa02-c2c9a0938eaf" released by "delete_volume" :: held 0.826s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Created reservations ['e20312c2-77a4-4ed0-b5a9-da749e1a8a98', '931d250e-1e9b-420b-8c8e-699f1ff73a1f', '0cf5c6f6-601c-4558-8bba-cc68ea7169c8', '2af43494-ecae-4bc1-85ac-c29e01f709c1'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:16 devstack sudo[94021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:16 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:16 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Flow 'volume_create_manager' (1552da1a-8dbd-4398-997e-76769623a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795d755b-dbf2-41d3-95c4-66e5bcac4296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Deleted volume successfully.
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795d755b-dbf2-41d3-95c4-66e5bcac4296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1804731984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ce96d2-62aa-40e9-9868-3b5cf93d4e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e557ee0033469295d4db4bc8549a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:17Z,use_quota=True,user_id='cd7583f50ffc402dbd49f3f609cd95b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a48007e-6b0f-46d7-a8ab-190ad199fcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a48007e-6b0f-46d7-a8ab-190ad199fcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc01e8cb-b672-489e-9510-1a0123e52fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc01e8cb-b672-489e-9510-1a0123e52fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ce96d2-62aa-40e9-9868-3b5cf93d4e35', 'volume_name': 'volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6731ead-bfac-43a2-829a-4e7728373adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6731ead-bfac-43a2-829a-4e7728373adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cb470f-94ea-4118-b21f-17afcc936742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:16 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Volume c6ce96d2-62aa-40e9-9868-3b5cf93d4e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35', 'volume_size': 1}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1804731984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ce96d2-62aa-40e9-9868-3b5cf93d4e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e557ee0033469295d4db4bc8549a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:17Z,use_quota=True,user_id='cd7583f50ffc402dbd49f3f609cd95b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Creating volume c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:16 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d084e403-a249-47fc-8f70-6f0b83053d21 tempest-VolumesListAdminTestJSON-1058570176 None] Lock "cinder-16561774-252a-4a28-aa02-c2c9a0938eaf-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:16 devstack sudo[94028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 1073741824
Sep 25 18:31:16 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:17 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 1073741824" returned: 0 in 0.783s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:17 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35
Sep 25 18:31:17 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:17 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cb470f-94ea-4118-b21f-17afcc936742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6759c82f-0a74-4e1c-aa83-70730ee3d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:18 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Volume volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 (c6ce96d2-62aa-40e9-9868-3b5cf93d4e35): created successfully
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6759c82f-0a74-4e1c-aa83-70730ee3d285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Flow 'volume_create_manager' (1552da1a-8dbd-4398-997e-76769623a695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-064a479b-205e-4a6d-8352-23f81fc8656a tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Created volume successfully.
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Creating offline snapshot c717a21d-c3af-469b-817f-4a90fe0d2aec of volume c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca6650-4820-467b-80ea-65faa136be27]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:19 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35
Sep 25 18:31:19 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:19 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" returned: 0 in 0.482s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:19 devstack sudo[94065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec 1G
Sep 25 18:31:19 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:19 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec 1G" returned: 0 in 0.578s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:19 devstack sudo[94071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec
Sep 25 18:31:19 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:20 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:20 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec is being set with open permissions: ugo+rw
Sep 25 18:31:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:20 devstack sudo[94078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec
Sep 25 18:31:20 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:20 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec" returned: 0 in 0.303s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:20 devstack sudo[94081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info
Sep 25 18:31:20 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:21 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:21 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info is being set with open permissions: ugo+rw
Sep 25 18:31:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:21 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info
Sep 25 18:31:21 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:21 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.info" returned: 0 in 0.331s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-85694454-2916-4a38-8c9b-d31eba702b72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Create snapshot completed successfully
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "cinder-c717a21d-c3af-469b-817f-4a90fe0d2aec-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-c717a21d-c3af-469b-817f-4a90fe0d2aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "cinder-quobyte-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-quobyte-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "cinder-quobyte-c717a21d-c3af-469b-817f-4a90fe0d2aec" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-quobyte-c717a21d-c3af-469b-817f-4a90fe0d2aec" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Deleting offline snapshot c717a21d-c3af-469b-817f-4a90fe0d2aec of volume c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] snapshot_file for this snap is: volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc9d30-4bd5-4682-8c51-78a39cf2b849]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:22 devstack sudo[94087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec
Sep 25 18:31:22 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:23 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:31:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7362514-1f97-4943-b3ab-f272c469a906]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:23 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35
Sep 25 18:31:23 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:23 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" returned: 0 in 0.657s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:23 devstack sudo[94134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec
Sep 25 18:31:23 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:24 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec" returned: 0 in 0.497s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:24 devstack sudo[94139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec
Sep 25 18:31:24 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:24 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35.c717a21d-c3af-469b-817f-4a90fe0d2aec" returned: 0 in 0.370s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-quobyte-c717a21d-c3af-469b-817f-4a90fe0d2aec" released by "_delete_snapshot" :: held 2.131s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-quobyte-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" released by "delete_snapshot" :: held 2.162s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:24 devstack cinder-volume[86534]: WARNING cinder.quota [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:31:24 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Created reservations ['9a349d48-f276-43fd-a6dd-83e3670daf06', 'f859a079-c7a0-4293-980e-b4114654ae86', '1afba52f-8d89-4658-83cb-54c73625c2f7', 'e90310c9-7a0b-4cdb-80b8-bc4c4ec37e2a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Delete snapshot completed successfully.
Sep 25 18:31:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9312254e-a2b6-4d21-94b0-4c279213b3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-c717a21d-c3af-469b-817f-4a90fe0d2aec-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "cinder-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "cinder-quobyte-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-quobyte-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec908854-fff8-4c41-8377-d08afe9e1b7d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:26 devstack sudo[94143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35
Sep 25 18:31:26 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:26 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" returned: 0 in 0.443s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:26 devstack sudo[94148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35
Sep 25 18:31:26 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:26 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" returned: 0 in 0.289s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-quobyte-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35" released by "delete_volume" :: held 0.826s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:26 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Created reservations ['0dae89a7-551c-4723-a6de-217ee8469923', 'c1e4c8be-084c-4075-b389-918dc64b923c', '2de52a85-b706-4c31-9c79-7437fb9bde4b', '0dd0b31c-b4c1-412e-be24-2a32768cf64e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:27 devstack sudo[94151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:27 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:27 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.363s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Deleted volume successfully.
Sep 25 18:31:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1d35625-2aec-4d79-af54-74e1bb2a506f tempest-VolumeSnapshotQuotasNegativeTestJSON-1893988599 None] Lock "cinder-c6ce96d2-62aa-40e9-9868-3b5cf93d4e35-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Flow 'volume_create_manager' (998693e9-0157-4d83-a085-47bb4a5f1ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef7ccfb-0641-436f-8275-061416eaa035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef7ccfb-0641-436f-8275-061416eaa035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-684832972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0888d7c4-ebda-4139-8676-7d65d1c6e94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ef0c11a7bb4315b055e8136a7ab947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:33Z,use_quota=True,user_id='c15c0da7cf124423ab15fddec4dcce96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36e66e7-7230-47ee-8504-193fff43db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36e66e7-7230-47ee-8504-193fff43db32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e9131b-67de-4424-8158-f4eb45abc8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e9131b-67de-4424-8158-f4eb45abc8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0888d7c4-ebda-4139-8676-7d65d1c6e94c', 'volume_name': 'volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59142f1a-9fdb-406a-84dc-f833839cda6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59142f1a-9fdb-406a-84dc-f833839cda6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bff8b36-a634-49fb-959f-299855d5645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:32 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Volume 0888d7c4-ebda-4139-8676-7d65d1c6e94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c', 'volume_size': 1}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-684832972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0888d7c4-ebda-4139-8676-7d65d1c6e94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ef0c11a7bb4315b055e8136a7ab947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:33Z,use_quota=True,user_id='c15c0da7cf124423ab15fddec4dcce96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Creating volume 0888d7c4-ebda-4139-8676-7d65d1c6e94c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:32 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:32 devstack sudo[94165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c 1073741824
Sep 25 18:31:32 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:33 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c 1073741824" returned: 0 in 0.637s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:33 devstack sudo[94185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c
Sep 25 18:31:33 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:34 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c" returned: 0 in 0.520s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bff8b36-a634-49fb-959f-299855d5645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982534a7-0901-4020-a4be-b1683ca728c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Volume volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c (0888d7c4-ebda-4139-8676-7d65d1c6e94c): created successfully
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982534a7-0901-4020-a4be-b1683ca728c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Flow 'volume_create_manager' (998693e9-0157-4d83-a085-47bb4a5f1ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:34 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-46ff352b-644f-4182-ae84-22e196f43198 tempest-AbsoluteLimitsTests-501205954 None] Created volume successfully.
Sep 25 18:31:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Acquiring lock "cinder-0888d7c4-ebda-4139-8676-7d65d1c6e94c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Lock "cinder-0888d7c4-ebda-4139-8676-7d65d1c6e94c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Acquiring lock "cinder-quobyte-0888d7c4-ebda-4139-8676-7d65d1c6e94c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Lock "cinder-quobyte-0888d7c4-ebda-4139-8676-7d65d1c6e94c" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd099bb-c7ad-411e-9527-e053cce9f04d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:35 devstack sudo[94205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c
Sep 25 18:31:35 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:36 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c" returned: 0 in 0.532s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:36 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c
Sep 25 18:31:36 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Flow 'volume_create_manager' (feda4007-030f-4cd6-94f3-a7d8cd5f8527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7cfd84-46d6-4d6f-9c1a-57d929d2dec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7cfd84-46d6-4d6f-9c1a-57d929d2dec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1703411675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2fe56e-e664-4b4c-8491-5f7db5ebae5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='469f6c68dcf7425d9fdfc4553ab325d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:36Z,use_quota=True,user_id='760a4abe382e48d9842450d8381c1859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c186fed4-4d16-45e4-a7a6-f408983d65aa),volume_type_id=c186fed4-4d16-45e4-a7a6-f408983d65aa)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:36 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395d2573-e2ca-40f1-8524-3fb137616d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395d2573-e2ca-40f1-8524-3fb137616d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95015756-e032-4ccc-abd5-4405d7246feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95015756-e032-4ccc-abd5-4405d7246feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e2fe56e-e664-4b4c-8491-5f7db5ebae5c', 'volume_name': 'volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23dd29f-8c9f-44b2-84a3-8aa071dc2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23dd29f-8c9f-44b2-84a3-8aa071dc2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf58128-f00e-4ebe-86b8-afe4f7182c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Volume 8e2fe56e-e664-4b4c-8491-5f7db5ebae5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c', 'volume_size': 1}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1703411675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e2fe56e-e664-4b4c-8491-5f7db5ebae5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='469f6c68dcf7425d9fdfc4553ab325d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:36Z,use_quota=True,user_id='760a4abe382e48d9842450d8381c1859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c186fed4-4d16-45e4-a7a6-f408983d65aa),volume_type_id=c186fed4-4d16-45e4-a7a6-f408983d65aa)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Creating volume 8e2fe56e-e664-4b4c-8491-5f7db5ebae5c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:36 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0888d7c4-ebda-4139-8676-7d65d1c6e94c" returned: 0 in 0.484s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:36 devstack sudo[94215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c 1073741824
Sep 25 18:31:36 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Lock "cinder-quobyte-0888d7c4-ebda-4139-8676-7d65d1c6e94c" released by "delete_volume" :: held 1.086s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Created reservations ['8a250cc6-70b8-4a6f-b6a2-b6af3d7c83ed', '5083c934-6b15-484d-a61f-b8488c7af106', '25dc3f0d-c97f-44c7-b6ac-9d7940bd2324', 'a1393a9a-38b7-4981-842f-1ed8f6bb615b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:36 devstack sudo[94217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:36 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:37 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.628s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:37 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Deleted volume successfully.
Sep 25 18:31:37 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-97f7c5b7-2a75-494e-a144-8775b858ffb2 tempest-AbsoluteLimitsTests-501205954 None] Lock "cinder-0888d7c4-ebda-4139-8676-7d65d1c6e94c-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c 1073741824" returned: 0 in 0.940s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:37 devstack sudo[94263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c
Sep 25 18:31:37 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:38 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c" returned: 0 in 0.528s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf58128-f00e-4ebe-86b8-afe4f7182c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea9f1fc-e836-4d38-b7b3-b3b8d1f0d32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Volume volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c (8e2fe56e-e664-4b4c-8491-5f7db5ebae5c): created successfully
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea9f1fc-e836-4d38-b7b3-b3b8d1f0d32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Flow 'volume_create_manager' (feda4007-030f-4cd6-94f3-a7d8cd5f8527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-774cce71-f418-409a-8fb0-38938f070342 tempest-VolumeTypesAccessTest-2127600030 None] Created volume successfully.
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Acquiring lock "cinder-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Lock "cinder-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Acquiring lock "cinder-quobyte-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Lock "cinder-quobyte-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1417c-64b6-4b16-95f1-11b6a0327695]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:39 devstack sudo[94322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c
Sep 25 18:31:39 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:39 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c" returned: 0 in 0.637s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:39 devstack sudo[94358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c
Sep 25 18:31:39 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:39 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c" returned: 0 in 0.281s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Lock "cinder-quobyte-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c" released by "delete_volume" :: held 0.998s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:39 devstack cinder-volume[86534]: WARNING cinder.quota [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-114122081 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-114122081, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:31:39 devstack cinder-volume[86534]: WARNING cinder.quota [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-114122081 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-114122081, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Created reservations ['4d0d0352-0ffd-4b6b-bb02-749a21306aa3', '127e6bda-87ad-459d-a305-81ec84c309e0', 'e1bd5a91-bf37-41c8-a295-d2e92fcc6011', 'eb728420-6887-4025-8fcb-7a2999523df1'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:40 devstack sudo[94371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:40 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:40 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.331s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:40 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Deleted volume successfully.
Sep 25 18:31:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3209b191-a7dd-458f-85c3-0be9118f9f35 tempest-VolumeTypesAccessTest-2127600030 None] Lock "cinder-8e2fe56e-e664-4b4c-8491-5f7db5ebae5c-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:44 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:31:44 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:44 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.720s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Flow 'volume_create_manager' (c536bb5d-d801-4c3e-bc4b-afa5dee47c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8d313c-5bd9-4a96-b9b7-237c1795b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8d313c-5bd9-4a96-b9b7-237c1795b717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1976349447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b547495-34b2-412c-9f0f-f393f190f0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bb4e07f8524a16beab48fe5bc8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:47Z,use_quota=True,user_id='e39720bb2a5d4ce28684cb4701261c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873692e6-0481-403e-bd1d-fddf2461a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873692e6-0481-403e-bd1d-fddf2461a33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5e7639-1ec6-42c9-a132-df8eb17632dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5e7639-1ec6-42c9-a132-df8eb17632dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b547495-34b2-412c-9f0f-f393f190f0e6', 'volume_name': 'volume-9b547495-34b2-412c-9f0f-f393f190f0e6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4992bd70-8664-4e1f-a9b7-1727e293fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4992bd70-8664-4e1f-a9b7-1727e293fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9c972a-4a52-425e-80bd-f4ea59d41b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Volume 9b547495-34b2-412c-9f0f-f393f190f0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b547495-34b2-412c-9f0f-f393f190f0e6', 'volume_size': 1}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1976349447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b547495-34b2-412c-9f0f-f393f190f0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bb4e07f8524a16beab48fe5bc8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:47Z,use_quota=True,user_id='e39720bb2a5d4ce28684cb4701261c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Creating volume 9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:47 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:47 devstack sudo[94414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 1073741824
Sep 25 18:31:47 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:48 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 1073741824" returned: 0 in 0.792s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:48 devstack sudo[94421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6
Sep 25 18:31:48 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:49 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6" returned: 0 in 0.478s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9c972a-4a52-425e-80bd-f4ea59d41b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b547495-34b2-412c-9f0f-f393f190f0e6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26abf39d-7ecc-4d92-a041-abecaa10fa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Volume volume-9b547495-34b2-412c-9f0f-f393f190f0e6 (9b547495-34b2-412c-9f0f-f393f190f0e6): created successfully
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26abf39d-7ecc-4d92-a041-abecaa10fa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Flow 'volume_create_manager' (c536bb5d-d801-4c3e-bc4b-afa5dee47c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-11ee226e-cfc9-4cf8-8497-1b1390d5216a tempest-VolumesDeleteCascade-992463220 None] Created volume successfully.
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Creating offline snapshot c7836f97-3e3c-491a-9c2c-3b41fba3b044 of volume 9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[885987b3-517c-4846-8c94-18627e1ed3bc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:50 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6
Sep 25 18:31:50 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:50 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6" returned: 0 in 0.543s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:50 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 1G
Sep 25 18:31:50 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:51 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 1G" returned: 0 in 0.576s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b547495-34b2-412c-9f0f-f393f190f0e6 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:51 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b547495-34b2-412c-9f0f-f393f190f0e6 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:51 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:51 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b547495-34b2-412c-9f0f-f393f190f0e6 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 is being set with open permissions: ugo+rw
Sep 25 18:31:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:51 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:51 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:51 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.281s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=73,cinder:UPDATE=115,cinder:INSERT=24,cinder:DELETE=9 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=93,cinder:INSERT=26,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:52 devstack sudo[94443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info
Sep 25 18:31:52 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:52 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info" returned: 0 in 0.375s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:52 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info is being set with open permissions: ugo+rw
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:52 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info
Sep 25 18:31:52 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:52 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.info" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fca4de4a-929a-4deb-bda6-4eae7e255111 tempest-VolumesDeleteCascade-992463220 None] Create snapshot completed successfully
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Flow 'volume_create_manager' (9a5616c1-230d-4839-b7f8-deb7f814551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe726f4-a884-4bd9-8321-c577f5a8dd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe726f4-a884-4bd9-8321-c577f5a8dd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-46058399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfeac1e-68a8-4698-8335-92fe87676b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fe1fcc19e84e0b83b49a88a45e3e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:53Z,use_quota=True,user_id='bc331a08ccbd4493a4b5e90d94966dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028deb9d-5f49-468f-8dce-b2984ea82812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028deb9d-5f49-468f-8dce-b2984ea82812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f43699-0569-479c-b877-cf578c498949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f43699-0569-479c-b877-cf578c498949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dfeac1e-68a8-4698-8335-92fe87676b74', 'volume_name': 'volume-5dfeac1e-68a8-4698-8335-92fe87676b74', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7917579-a34c-4c89-9376-36ac642f529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7917579-a34c-4c89-9376-36ac642f529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f784a31-1afe-43ff-853e-1a051a66a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Volume 5dfeac1e-68a8-4698-8335-92fe87676b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dfeac1e-68a8-4698-8335-92fe87676b74', 'volume_size': 1}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-46058399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dfeac1e-68a8-4698-8335-92fe87676b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fe1fcc19e84e0b83b49a88a45e3e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:31:53Z,use_quota=True,user_id='bc331a08ccbd4493a4b5e90d94966dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Creating volume 5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:31:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:53 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 1073741824
Sep 25 18:31:53 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:53 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 1073741824" returned: 0 in 0.460s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:53 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74
Sep 25 18:31:53 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:54 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74" returned: 0 in 0.276s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Creating offline snapshot 9f9f01aa-b102-45b2-87e0-84a3e2b38688 of volume 9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f784a31-1afe-43ff-853e-1a051a66a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dfeac1e-68a8-4698-8335-92fe87676b74', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c1e0bd-c9d7-433b-828e-43498ba1f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94449cc-01b5-43f9-9b01-128403e06360]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Volume volume-5dfeac1e-68a8-4698-8335-92fe87676b74 (5dfeac1e-68a8-4698-8335-92fe87676b74): created successfully
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c1e0bd-c9d7-433b-828e-43498ba1f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Flow 'volume_create_manager' (9a5616c1-230d-4839-b7f8-deb7f814551f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:31:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-50a3d4bd-f25f-4e32-ad6e-36f84882b2d8 tempest-SnapshotMetadataTestJSON-480104658 None] Created volume successfully.
Sep 25 18:31:54 devstack sudo[94458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:54 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:54 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.459s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b547495-34b2-412c-9f0f-f393f190f0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:31:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:54 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 1G
Sep 25 18:31:54 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:55 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 1G" returned: 0 in 0.444s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:55 devstack sudo[94469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688
Sep 25 18:31:55 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:55 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688" returned: 0 in 0.438s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:55 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 is being set with open permissions: ugo+rw
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:55 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688
Sep 25 18:31:55 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:31:55 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688" returned: 0 in 0.272s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.738s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.270s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Creating offline snapshot 963bb8ab-da1a-4ff3-801d-2d14996c8667 of volume 5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc742243-ab5a-44ef-987d-7dd2297da07a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-aaa2bd6e-1d65-4224-b5ae-89aa541f1b63 tempest-VolumesDeleteCascade-992463220 None] Create snapshot completed successfully
Sep 25 18:31:56 devstack sudo[94522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74
Sep 25 18:31:56 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:56 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:56 devstack sudo[94527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 1G
Sep 25 18:31:56 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-9b547495-34b2-412c-9f0f-f393f190f0e6-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-9b547495-34b2-412c-9f0f-f393f190f0e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Performing cascade delete. {{(pid=86534) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-9f9f01aa-b102-45b2-87e0-84a3e2b38688-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-9f9f01aa-b102-45b2-87e0-84a3e2b38688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-9f9f01aa-b102-45b2-87e0-84a3e2b38688" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9f9f01aa-b102-45b2-87e0-84a3e2b38688" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Deleting offline snapshot 9f9f01aa-b102-45b2-87e0-84a3e2b38688 of volume 9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:31:56 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] snapshot_file for this snap is: volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 1G" returned: 0 in 0.494s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dfeac1e-68a8-4698-8335-92fe87676b74 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8023ef9d-fa3b-4d82-98a4-4c0fc915e535]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:56 devstack sudo[94534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dfeac1e-68a8-4698-8335-92fe87676b74 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667
Sep 25 18:31:56 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:56 devstack sudo[94535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688
Sep 25 18:31:56 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:57 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dfeac1e-68a8-4698-8335-92fe87676b74 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667" returned: 0 in 0.299s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:57 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 is being set with open permissions: ugo+rw
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:57 devstack sudo[94541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667
Sep 25 18:31:57 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:57 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b547495-34b2-412c-9f0f-f393f190f0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1309b700-f223-4e99-82c5-7361fa1656ca]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:57 devstack sudo[94546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:57 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:57 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:57 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info
Sep 25 18:31:57 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:57 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.401s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b547495-34b2-412c-9f0f-f393f190f0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:57 devstack sudo[94555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688
Sep 25 18:31:57 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:57 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:57 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info is being set with open permissions: ugo+rw
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:57 devstack sudo[94557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info
Sep 25 18:31:57 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:57 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.info" returned: 0 in 0.269s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:31:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-646892b5-d9fb-4e9c-bc40-c0530c606305 tempest-SnapshotMetadataTestJSON-480104658 None] Create snapshot completed successfully
Sep 25 18:31:58 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688" returned: 0 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:58 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688
Sep 25 18:31:58 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:58 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.9f9f01aa-b102-45b2-87e0-84a3e2b38688" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9f9f01aa-b102-45b2-87e0-84a3e2b38688" released by "_delete_snapshot" :: held 1.498s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" released by "delete_snapshot" :: held 1.523s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Created reservations ['5611c790-f23a-473a-9bc3-fd4014758eaa', '0d7e15b0-5b5f-42c5-918c-79b99b162b9b', '25cc4c6e-ab68-4d26-ae6c-4903e11d1058', '7e37b291-4e23-4675-bea4-e790287ab31e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:31:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Delete snapshot completed successfully.
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-9f9f01aa-b102-45b2-87e0-84a3e2b38688-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-c7836f97-3e3c-491a-9c2c-3b41fba3b044-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-c7836f97-3e3c-491a-9c2c-3b41fba3b044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-c7836f97-3e3c-491a-9c2c-3b41fba3b044" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-c7836f97-3e3c-491a-9c2c-3b41fba3b044" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Deleting offline snapshot c7836f97-3e3c-491a-9c2c-3b41fba3b044 of volume 9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] snapshot_file for this snap is: volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f28bbb8-ab07-4895-a46d-f4aeb476db2d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:58 devstack sudo[94567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:58 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:58 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.388s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b547495-34b2-412c-9f0f-f393f190f0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9493a428-e6fb-4b19-8500-d31794d678b4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:59 devstack sudo[94573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6
Sep 25 18:31:59 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:59 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:59 devstack sudo[94578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:59 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "cinder-963bb8ab-da1a-4ff3-801d-2d14996c8667-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-963bb8ab-da1a-4ff3-801d-2d14996c8667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "cinder-quobyte-5dfeac1e-68a8-4698-8335-92fe87676b74" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-quobyte-5dfeac1e-68a8-4698-8335-92fe87676b74" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "cinder-quobyte-963bb8ab-da1a-4ff3-801d-2d14996c8667" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-quobyte-963bb8ab-da1a-4ff3-801d-2d14996c8667" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Deleting offline snapshot 963bb8ab-da1a-4ff3-801d-2d14996c8667 of volume 5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] snapshot_file for this snap is: volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dfba6f-2b3c-4e36-bbfb-3fe77ae30a08]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:59 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667
Sep 25 18:31:59 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:59 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.336s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:59 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044
Sep 25 18:31:59 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:31:59 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dfeac1e-68a8-4698-8335-92fe87676b74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:31:59 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6.c7836f97-3e3c-491a-9c2c-3b41fba3b044" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[92be6a8d-0a7d-474e-854b-e00d684f1b1b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-c7836f97-3e3c-491a-9c2c-3b41fba3b044" released by "_delete_snapshot" :: held 1.490s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:31:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" released by "delete_snapshot" :: held 1.512s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Created reservations ['40eecd9e-ab13-4a3f-a4b2-6f3e3bcafdb6', '2cb0dbb2-f78c-4967-b205-ed8714b81fce', '92519e66-f21e-4231-aea6-3644e475b0a1', '08471209-ebaa-4beb-b4a8-3deb0ad58240'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:00 devstack sudo[94591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74
Sep 25 18:32:00 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Delete snapshot completed successfully.
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-c7836f97-3e3c-491a-9c2c-3b41fba3b044-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Snapshots deleted, issuing volume delete {{(pid=86534) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8f859b-118e-449e-bf1e-7330f8d9f897]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:00 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6
Sep 25 18:32:00 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:00 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:00 devstack sudo[94598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667
Sep 25 18:32:00 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:00 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:00 devstack sudo[94603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6
Sep 25 18:32:00 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:00 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667" returned: 0 in 0.343s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:00 devstack sudo[94608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667
Sep 25 18:32:00 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:00 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9b547495-34b2-412c-9f0f-f393f190f0e6" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-9b547495-34b2-412c-9f0f-f393f190f0e6" released by "delete_volume" :: held 0.709s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Created reservations ['1c85a3a7-6447-4b5d-a37b-03337f918026', '9f8cede6-cc54-4fa3-9736-588733ec8a84', '432207e0-e5b4-455a-b0c2-6ea6dad85a69', '3ac9338d-1fff-4a33-8bf5-782b449e520f'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:00 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74.963bb8ab-da1a-4ff3-801d-2d14996c8667" returned: 0 in 0.259s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:00 devstack sudo[94613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:00 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-quobyte-963bb8ab-da1a-4ff3-801d-2d14996c8667" released by "_delete_snapshot" :: held 1.523s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-quobyte-5dfeac1e-68a8-4698-8335-92fe87676b74" released by "delete_snapshot" :: held 1.547s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Created reservations ['928847c7-fe04-4c68-a28d-c57fc237c473', 'e1443386-1bb9-4e3f-8338-b56b1d5216ef', '308326bf-7d6a-4a6c-8ab7-4bb9cafb94b0', '13f52a1e-96fb-46cf-9fe9-1ea835ba5ea5'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Delete snapshot completed successfully.
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f8ecb9d5-b4b5-490e-924e-523452bf5cf7 tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-963bb8ab-da1a-4ff3-801d-2d14996c8667-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:01 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.297s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Deleted volume successfully.
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-63fbf88b-369e-456b-a727-a0c45070a3ef tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-9b547495-34b2-412c-9f0f-f393f190f0e6-delete_volume" released by "delete_volume" :: held 4.557s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "cinder-5dfeac1e-68a8-4698-8335-92fe87676b74-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-5dfeac1e-68a8-4698-8335-92fe87676b74-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "cinder-quobyte-5dfeac1e-68a8-4698-8335-92fe87676b74" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-quobyte-5dfeac1e-68a8-4698-8335-92fe87676b74" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3b622-1dff-4deb-8851-e5990980803a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Flow 'volume_create_manager' (8f665e36-f2c1-41ae-8f0e-84297a540bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33b3647-9804-47ec-9034-cd31dc5e7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:01 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74
Sep 25 18:32:01 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33b3647-9804-47ec-9034-cd31dc5e7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1171893431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67b6be1-930e-4351-ae38-dc381f1d944d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bb4e07f8524a16beab48fe5bc8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:02Z,use_quota=True,user_id='e39720bb2a5d4ce28684cb4701261c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484af746-cc3a-40fa-b41f-ecb2356b79c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484af746-cc3a-40fa-b41f-ecb2356b79c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7937602-921f-469d-a75b-7faf4b703e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7937602-921f-469d-a75b-7faf4b703e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67b6be1-930e-4351-ae38-dc381f1d944d', 'volume_name': 'volume-a67b6be1-930e-4351-ae38-dc381f1d944d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f25678-1e35-41b3-9638-ce364da6b200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f25678-1e35-41b3-9638-ce364da6b200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7330218-04bd-4305-8b4a-b2e68c04562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:02 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Volume a67b6be1-930e-4351-ae38-dc381f1d944d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67b6be1-930e-4351-ae38-dc381f1d944d', 'volume_size': 1}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1171893431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67b6be1-930e-4351-ae38-dc381f1d944d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bb4e07f8524a16beab48fe5bc8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:02Z,use_quota=True,user_id='e39720bb2a5d4ce28684cb4701261c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Creating volume a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:02 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:02 devstack sudo[94618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d 1073741824
Sep 25 18:32:02 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:02 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74" returned: 0 in 0.374s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:02 devstack sudo[94623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74
Sep 25 18:32:02 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:02 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5dfeac1e-68a8-4698-8335-92fe87676b74" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-quobyte-5dfeac1e-68a8-4698-8335-92fe87676b74" released by "delete_volume" :: held 0.717s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:02 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d 1073741824" returned: 0 in 0.487s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Created reservations ['a0cf8015-ade9-497a-8507-a80fcd4ee1a1', '70d515d5-51c4-4d7f-87d4-a1c8cac17636', '5a6ac11c-04c0-407d-b3f0-0420e46e1c51', '9c8e93ce-0e20-4299-99d5-90992a7e4262'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:02 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d
Sep 25 18:32:02 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:02 devstack sudo[94632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:02 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:02 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d" returned: 0 in 0.287s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7330218-04bd-4305-8b4a-b2e68c04562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67b6be1-930e-4351-ae38-dc381f1d944d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a125dad9-6aed-4775-9e1e-31d34e656de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:02 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Volume volume-a67b6be1-930e-4351-ae38-dc381f1d944d (a67b6be1-930e-4351-ae38-dc381f1d944d): created successfully
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a125dad9-6aed-4775-9e1e-31d34e656de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Flow 'volume_create_manager' (8f665e36-f2c1-41ae-8f0e-84297a540bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:02 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a05c0ec4-80e9-4d18-8d3f-6b24b56053dd tempest-VolumesDeleteCascade-992463220 None] Created volume successfully.
Sep 25 18:32:03 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:03 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Deleted volume successfully.
Sep 25 18:32:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-21f81eac-04ef-44a7-b7fd-b8b341f6d7ea tempest-SnapshotMetadataTestJSON-480104658 None] Lock "cinder-5dfeac1e-68a8-4698-8335-92fe87676b74-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Creating offline snapshot e8fe124c-f893-4acc-98e3-e2907deb180e of volume a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0903ee-0738-4235-a606-1aa8eae8ca02]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:04 devstack sudo[94638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d
Sep 25 18:32:04 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:04 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d" returned: 0 in 0.426s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:04 devstack sudo[94643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e 1G
Sep 25 18:32:04 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:05 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e 1G" returned: 0 in 0.555s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a67b6be1-930e-4351-ae38-dc381f1d944d -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:05 devstack sudo[94654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a67b6be1-930e-4351-ae38-dc381f1d944d -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e
Sep 25 18:32:05 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:05 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a67b6be1-930e-4351-ae38-dc381f1d944d -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e" returned: 0 in 0.326s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:05 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e is being set with open permissions: ugo+rw
Sep 25 18:32:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:05 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e
Sep 25 18:32:05 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:05 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:05 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info
Sep 25 18:32:05 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:06 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info" returned: 0 in 0.280s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:06 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info is being set with open permissions: ugo+rw
Sep 25 18:32:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:06 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info
Sep 25 18:32:06 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:06 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.info" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-943a229c-cb9d-4ba8-9bf8-2cdde6778792 tempest-VolumesDeleteCascade-992463220 None] Create snapshot completed successfully
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Flow 'volume_create_manager' (fecff779-bfbc-4889-9d29-bd891cfbd801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc18e1d-72b6-4a00-9100-03971f3d8a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc18e1d-72b6-4a00-9100-03971f3d8a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-820309294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c6da39-9f8b-4da5-8eec-a58f664f482f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f85275ed7384d7e81f63bdafe68e346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:07Z,use_quota=True,user_id='8d16de3af07441f89d38763215322d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f8b58a-1870-4e6e-a340-829ac933e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52f8b58a-1870-4e6e-a340-829ac933e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c722a5f-21e2-4791-ae96-3aea7f47a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c722a5f-21e2-4791-ae96-3aea7f47a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c6da39-9f8b-4da5-8eec-a58f664f482f', 'volume_name': 'volume-19c6da39-9f8b-4da5-8eec-a58f664f482f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2570f0d6-604e-4950-8f49-a3a50567e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2570f0d6-604e-4950-8f49-a3a50567e35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b58505-776e-451b-9cb2-0cf1efd3f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Volume 19c6da39-9f8b-4da5-8eec-a58f664f482f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c6da39-9f8b-4da5-8eec-a58f664f482f', 'volume_size': 1}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-820309294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c6da39-9f8b-4da5-8eec-a58f664f482f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f85275ed7384d7e81f63bdafe68e346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:07Z,use_quota=True,user_id='8d16de3af07441f89d38763215322d28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Creating volume 19c6da39-9f8b-4da5-8eec-a58f664f482f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:07 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:07 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f 1073741824
Sep 25 18:32:07 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:07 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f 1073741824" returned: 0 in 0.523s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:07 devstack sudo[94686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f
Sep 25 18:32:07 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:08 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f" returned: 0 in 0.296s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Flow 'volume_create_manager' (6821a863-6b90-4de0-8351-86a4051b552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aead492-108d-4be6-a096-d3cee359ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b58505-776e-451b-9cb2-0cf1efd3f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c6da39-9f8b-4da5-8eec-a58f664f482f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea059c6f-c973-4458-a691-49529eaf226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aead492-108d-4be6-a096-d3cee359ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1647655917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70c0958-0f4b-4a38-bd8f-a932095958a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bb4e07f8524a16beab48fe5bc8f74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e8fe124c-f893-4acc-98e3-e2907deb180e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:08Z,use_quota=True,user_id='e39720bb2a5d4ce28684cb4701261c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c61583d-64da-4c7d-8e88-5998d531f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c61583d-64da-4c7d-8e88-5998d531f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a76538-b6fb-4944-9098-6c4b1b53d2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a76538-b6fb-4944-9098-6c4b1b53d2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c70c0958-0f4b-4a38-bd8f-a932095958a9', 'volume_name': 'volume-c70c0958-0f4b-4a38-bd8f-a932095958a9', 'volume_size': 1, 'snapshot_id': 'e8fe124c-f893-4acc-98e3-e2907deb180e'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252bb4db-7190-4229-b01c-5239814e9d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (252bb4db-7190-4229-b01c-5239814e9d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093d6b53-2a37-4d49-9e9f-2b3226e70029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Volume c70c0958-0f4b-4a38-bd8f-a932095958a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c70c0958-0f4b-4a38-bd8f-a932095958a9', 'volume_size': 1, 'snapshot_id': 'e8fe124c-f893-4acc-98e3-e2907deb180e'}
Sep 25 18:32:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Volume volume-19c6da39-9f8b-4da5-8eec-a58f664f482f (19c6da39-9f8b-4da5-8eec-a58f664f482f): created successfully
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea059c6f-c973-4458-a691-49529eaf226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Flow 'volume_create_manager' (fecff779-bfbc-4889-9d29-bd891cfbd801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-e8fe124c-f893-4acc-98e3-e2907deb180e-c70c0958-0f4b-4a38-bd8f-a932095958a9" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0ff095e7-3a19-4571-b7dc-058c03a81b76 tempest-AttachVolumeShelveTestJSON-1021409735 None] Created volume successfully.
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-e8fe124c-f893-4acc-98e3-e2907deb180e-c70c0958-0f4b-4a38-bd8f-a932095958a9" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Creating volume c70c0958-0f4b-4a38-bd8f-a932095958a9 from snapshot e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-c70c0958-0f4b-4a38-bd8f-a932095958a9" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-c70c0958-0f4b-4a38-bd8f-a932095958a9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] snapshot: e8fe124c-f893-4acc-98e3-e2907deb180e, volume: c70c0958-0f4b-4a38-bd8f-a932095958a9,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a25bf4-c3a5-4256-b8dd-95a17b9edd40]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Flow 'volume_create_manager' (575f2c1d-1b3d-4b71-865a-bb35e9a33271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848ce8d8-ee85-4e15-9ccb-a0d106259a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848ce8d8-ee85-4e15-9ccb-a0d106259a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-186584834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8152040b0f0c46b494b2f3cb2114116b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:08Z,use_quota=True,user_id='b35681d92c884bc2bc4e5baa14e9c336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58edb18f-eaf4-4258-af48-4c8ac031a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58edb18f-eaf4-4258-af48-4c8ac031a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01737888-5766-4831-b75c-3df92c345973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01737888-5766-4831-b75c-3df92c345973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1', 'volume_name': 'volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ac2386-f058-4c60-b625-1400742f03c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ac2386-f058-4c60-b625-1400742f03c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02197f8c-d603-4141-b3cf-05ce68f4d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Volume 405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1', 'volume_size': 1}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:08 devstack sudo[94689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e
Sep 25 18:32:08 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:08 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e" returned: 0 in 0.406s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a67b6be1-930e-4351-ae38-dc381f1d944d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ecbf3-2bf9-4ac5-b77e-8b044a18246b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Flow 'volume_create_manager' (52023d05-90d1-4683-b176-f22a27ca9fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb131f02-7be4-46f0-85b4-694def92c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb131f02-7be4-46f0-85b4-694def92c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1988484718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfc6c17-1892-4d1c-a6e4-333c84a971f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb898823fa74e598cb53b838750f828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:09Z,use_quota=True,user_id='e2401b8941b240a991116370f23c4e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869d25c-c549-4b38-b976-501810c0d86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c869d25c-c549-4b38-b976-501810c0d86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68887d2-46ea-48ad-a2bf-4e388a63cd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68887d2-46ea-48ad-a2bf-4e388a63cd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfc6c17-1892-4d1c-a6e4-333c84a971f3', 'volume_name': 'volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc30039b-a247-4a7d-87b9-52492b9ffa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc30039b-a247-4a7d-87b9-52492b9ffa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:08 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a323c4fc-b90e-4217-ae94-7f9740a15a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Volume 9dfc6c17-1892-4d1c-a6e4-333c84a971f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3', 'volume_size': 1}
Sep 25 18:32:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:09 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:32:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:32:09 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:32:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:09 devstack sudo[94700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9
Sep 25 18:32:09 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:16 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9" returned: 0 in 7.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:32:16 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Converted 1024.00 MB image at 138.66 MB/s
Sep 25 18:32:16 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 is being set with open permissions: ugo+rw
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:16 devstack sudo[94735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9
Sep 25 18:32:16 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:16 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-c70c0958-0f4b-4a38-bd8f-a932095958a9" released by "_copy_volume_from_snapshot" :: held 8.526s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-e8fe124c-f893-4acc-98e3-e2907deb180e-c70c0958-0f4b-4a38-bd8f-a932095958a9" released by "_create_volume_from_snapshot" :: held 8.602s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.631s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.398s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-186584834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8152040b0f0c46b494b2f3cb2114116b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:08Z,use_quota=True,user_id='b35681d92c884bc2bc4e5baa14e9c336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Creating volume 405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:16 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:16 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 1073741824
Sep 25 18:32:16 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093d6b53-2a37-4d49-9e9f-2b3226e70029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70c0958-0f4b-4a38-bd8f-a932095958a9', 'volume_size': 1, 'snapshot_id': 'e8fe124c-f893-4acc-98e3-e2907deb180e'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa3b4cd-adbb-4fb7-8334-99ac64b31d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:16 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Volume volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 (c70c0958-0f4b-4a38-bd8f-a932095958a9): created successfully
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa3b4cd-adbb-4fb7-8334-99ac64b31d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Flow 'volume_create_manager' (6821a863-6b90-4de0-8351-86a4051b552c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-02a0fba5-4363-46e7-bddc-affd2914be82 tempest-VolumesDeleteCascade-992463220 None] Created volume successfully.
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-a67b6be1-930e-4351-ae38-dc381f1d944d-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-a67b6be1-930e-4351-ae38-dc381f1d944d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Performing cascade delete. {{(pid=86534) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-e8fe124c-f893-4acc-98e3-e2907deb180e-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-e8fe124c-f893-4acc-98e3-e2907deb180e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-a67b6be1-930e-4351-ae38-dc381f1d944d" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-a67b6be1-930e-4351-ae38-dc381f1d944d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-e8fe124c-f893-4acc-98e3-e2907deb180e" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-e8fe124c-f893-4acc-98e3-e2907deb180e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Deleting offline snapshot e8fe124c-f893-4acc-98e3-e2907deb180e of volume a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] snapshot_file for this snap is: volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a7f632-2cea-4ae1-a1ff-5b58028fecdb]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:17 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 1073741824" returned: 0 in 0.651s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:17 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1
Sep 25 18:32:17 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:17 devstack sudo[94744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e
Sep 25 18:32:17 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:17 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1" returned: 0 in 0.252s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.936s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1988484718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfc6c17-1892-4d1c-a6e4-333c84a971f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb898823fa74e598cb53b838750f828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:09Z,use_quota=True,user_id='e2401b8941b240a991116370f23c4e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Creating volume 9dfc6c17-1892-4d1c-a6e4-333c84a971f3 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:17 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:17 devstack sudo[94752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 1073741824
Sep 25 18:32:17 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02197f8c-d603-4141-b3cf-05ce68f4d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c8b85d-8b7f-4a09-8067-5a68b74f3c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:17 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Volume volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 (405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1): created successfully
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c8b85d-8b7f-4a09-8067-5a68b74f3c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Flow 'volume_create_manager' (575f2c1d-1b3d-4b71-865a-bb35e9a33271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:17 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7d547d95-b00d-4717-b76a-93b3fb46fd0e tempest-AttachVolumeNegativeTest-1017368670 None] Created volume successfully.
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e" returned: 0 in 0.431s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a67b6be1-930e-4351-ae38-dc381f1d944d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f0f430-0d89-48a9-92c0-e08881545931]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:18 devstack sudo[94755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d
Sep 25 18:32:18 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:18 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 1073741824" returned: 0 in 0.606s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:18 devstack sudo[94767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3
Sep 25 18:32:18 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:18 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d" returned: 0 in 0.724s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:18 devstack sudo[94772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e
Sep 25 18:32:18 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:18 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3" returned: 0 in 0.447s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a323c4fc-b90e-4217-ae94-7f9740a15a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdefce2-6884-4461-b1c4-d58a21670f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:18 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Volume volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 (9dfc6c17-1892-4d1c-a6e4-333c84a971f3): created successfully
Sep 25 18:32:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfdefce2-6884-4461-b1c4-d58a21670f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Flow 'volume_create_manager' (52023d05-90d1-4683-b176-f22a27ca9fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e5b2c207-1657-45ae-9d6f-8e6a231cfcec tempest-VolumesTransfersTest-184081698 None] Created volume successfully.
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-597f2a08-9c63-4129-8e21-4ff58d1b4a0f req-d3d89d71-4df4-42ea-8a57-5fca3f5e1690 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-597f2a08-9c63-4129-8e21-4ff58d1b4a0f req-d3d89d71-4df4-42ea-8a57-5fca3f5e1690 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-597f2a08-9c63-4129-8e21-4ff58d1b4a0f req-d3d89d71-4df4-42ea-8a57-5fca3f5e1690 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-597f2a08-9c63-4129-8e21-4ff58d1b4a0f req-d3d89d71-4df4-42ea-8a57-5fca3f5e1690 tempest-AttachVolumeNegativeTest-1017368670 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35c9fc84-083e-4adf-8054-26a69fb4dd2f', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:32:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-597f2a08-9c63-4129-8e21-4ff58d1b4a0f req-d3d89d71-4df4-42ea-8a57-5fca3f5e1690 tempest-AttachVolumeNegativeTest-1017368670 None] attachment_update completed successfully.
Sep 25 18:32:19 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e" returned: 0 in 0.700s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:19 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e
Sep 25 18:32:19 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:19 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d.e8fe124c-f893-4acc-98e3-e2907deb180e" returned: 0 in 0.355s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-e8fe124c-f893-4acc-98e3-e2907deb180e" released by "_delete_snapshot" :: held 2.376s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-a67b6be1-930e-4351-ae38-dc381f1d944d" released by "delete_snapshot" :: held 2.405s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Created reservations ['1916d43a-9183-49f0-8dfd-6fb1c19a918f', '9289db0c-a790-4aa0-9e1d-09c047c1e264', '7a17a54f-5bee-47bf-bad3-02e3c8c8a839', 'd56cfd4e-4ca0-4d62-a735-bef80e145118'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Delete snapshot completed successfully.
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-e8fe124c-f893-4acc-98e3-e2907deb180e-delete_snapshot" released by "delete_snapshot" :: held 2.650s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Snapshots deleted, issuing volume delete {{(pid=86534) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-a67b6be1-930e-4351-ae38-dc381f1d944d" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-a67b6be1-930e-4351-ae38-dc381f1d944d" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7415388-d8ac-4cc0-980b-af30d1b8a72c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:20 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d
Sep 25 18:32:20 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:20 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d" returned: 0 in 0.514s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:20 devstack sudo[95228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d
Sep 25 18:32:20 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-61a03bb1-cb4a-4439-be04-02886f7dc406 tempest-VolumesTransfersTest-1738899380 None] Transfer volume completed successfully.
Sep 25 18:32:20 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a67b6be1-930e-4351-ae38-dc381f1d944d" returned: 0 in 0.333s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-a67b6be1-930e-4351-ae38-dc381f1d944d" released by "delete_volume" :: held 0.937s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:20 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Created reservations ['26fb1235-1d82-4072-9b00-3522f7589809', '3f79653a-6c9b-470e-b654-0ea6380d2875', '1092d1c0-442d-421e-83a3-52ad7d2e5309', '2c5c6571-9706-49d1-a02b-128b8c0b50c6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:21 devstack sudo[95231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:21 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-fe64a671-9418-4d98-873d-ec6d608a2a87 req-b60f9f68-cb92-416d-b8da-9063eada1e8a tempest-AttachVolumeShelveTestJSON-1021409735 None] No connector for attachment 8fb33ebe-dcb2-4660-b9d7-c950aa83ebaa; skipping storage backend terminate_connection call. {{(pid=86534) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-fe64a671-9418-4d98-873d-ec6d608a2a87 req-b60f9f68-cb92-416d-b8da-9063eada1e8a tempest-AttachVolumeShelveTestJSON-1021409735 None] Deleting attachment 8fb33ebe-dcb2-4660-b9d7-c950aa83ebaa. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Acquiring lock "cinder-9dfc6c17-1892-4d1c-a6e4-333c84a971f3-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-9dfc6c17-1892-4d1c-a6e4-333c84a971f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:21 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.321s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Acquiring lock "cinder-quobyte-9dfc6c17-1892-4d1c-a6e4-333c84a971f3" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Deleted volume successfully.
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-quobyte-9dfc6c17-1892-4d1c-a6e4-333c84a971f3" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-89f0850f-da06-4d9b-a27e-de4fa4e88fb7 tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-a67b6be1-930e-4351-ae38-dc381f1d944d-delete_volume" released by "delete_volume" :: held 4.334s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca73c90-2b76-42ac-b747-d8f1487af22a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:21 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3
Sep 25 18:32:21 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-c70c0958-0f4b-4a38-bd8f-a932095958a9-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-c70c0958-0f4b-4a38-bd8f-a932095958a9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "cinder-quobyte-c70c0958-0f4b-4a38-bd8f-a932095958a9" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:22 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-c70c0958-0f4b-4a38-bd8f-a932095958a9" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3" returned: 0 in 0.568s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbdb010-0d75-46a5-9b24-0f71eaaeca40]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:22 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3
Sep 25 18:32:22 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:22 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9
Sep 25 18:32:22 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:22 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dfc6c17-1892-4d1c-a6e4-333c84a971f3" returned: 0 in 0.300s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-quobyte-9dfc6c17-1892-4d1c-a6e4-333c84a971f3" released by "delete_volume" :: held 0.937s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Created reservations ['1d1b1cb2-cacb-4c5e-84fb-d6abc3bf0e83', 'c88b690c-ee35-41a2-a2f4-41aaf3f6c001', '1f02d5d8-cd7d-4f2e-ae53-fa6a16bcd87f', '7957ba49-14b6-4342-a3fb-3f125cdc61d3'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-afca34e4-800d-4e7d-bcad-7290a4374103 req-857624e6-176c-4327-8f6e-77debe512934 tempest-AttachVolumeNegativeTest-1017368670 None] Terminate volume connection completed successfully.
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-afca34e4-800d-4e7d-bcad-7290a4374103 req-857624e6-176c-4327-8f6e-77debe512934 tempest-AttachVolumeNegativeTest-1017368670 None] Deleting attachment 35c9fc84-083e-4adf-8054-26a69fb4dd2f. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:22 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9" returned: 0 in 0.544s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:22 devstack sudo[95281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:22 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:22 devstack sudo[95282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9
Sep 25 18:32:22 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:22 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.286s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:22 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Deleted volume successfully.
Sep 25 18:32:23 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c70c0958-0f4b-4a38-bd8f-a932095958a9" returned: 0 in 0.316s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7355baf5-3454-4f17-983b-c2bd1be09917 tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-9dfc6c17-1892-4d1c-a6e4-333c84a971f3-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-quobyte-c70c0958-0f4b-4a38-bd8f-a932095958a9" released by "delete_volume" :: held 0.938s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Created reservations ['f7d20ad1-40f7-411a-87c0-c8f23484f993', '66929071-3a79-4ad8-93d8-c8f888b186b1', '813e5bc5-67dd-4b1d-a7b9-086cd08ecbd5', 'f84fa469-6849-4fcf-b6fa-fd1d2c666d95'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:23 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:23 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:23 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.363s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Deleted volume successfully.
Sep 25 18:32:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b2debeb5-7f75-4da7-854e-0eb79eb06cae tempest-VolumesDeleteCascade-992463220 None] Lock "cinder-c70c0958-0f4b-4a38-bd8f-a932095958a9-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Flow 'volume_create_manager' (12032645-ee9e-4a62-8f3e-26b557d618f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1bdc9b-7e3c-4879-b7c6-2d799a3e6171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1bdc9b-7e3c-4879-b7c6-2d799a3e6171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1586845798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a8f08e-eac0-4b33-be06-0d25af559757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb898823fa74e598cb53b838750f828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:25Z,use_quota=True,user_id='e2401b8941b240a991116370f23c4e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64adde44-1621-46af-85ec-1fe0c3c76c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64adde44-1621-46af-85ec-1fe0c3c76c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf23180-7794-4b5a-95e6-fbfbc9b276df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf23180-7794-4b5a-95e6-fbfbc9b276df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a8f08e-eac0-4b33-be06-0d25af559757', 'volume_name': 'volume-76a8f08e-eac0-4b33-be06-0d25af559757', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0292f62e-81c0-4e5f-bfb1-3399fc1fe1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0292f62e-81c0-4e5f-bfb1-3399fc1fe1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0caa3ce-5ed6-46c4-b87d-8a6bd63f428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Volume 76a8f08e-eac0-4b33-be06-0d25af559757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a8f08e-eac0-4b33-be06-0d25af559757', 'volume_size': 1}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1586845798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a8f08e-eac0-4b33-be06-0d25af559757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb898823fa74e598cb53b838750f828',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:25Z,use_quota=True,user_id='e2401b8941b240a991116370f23c4e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Creating volume 76a8f08e-eac0-4b33-be06-0d25af559757 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:24 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:24 devstack sudo[95350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757 1073741824
Sep 25 18:32:24 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:25 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757 1073741824" returned: 0 in 0.733s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:25 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757
Sep 25 18:32:25 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:26 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0caa3ce-5ed6-46c4-b87d-8a6bd63f428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a8f08e-eac0-4b33-be06-0d25af559757', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9dcb545-b1be-447c-b592-3f997fe17458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Volume volume-76a8f08e-eac0-4b33-be06-0d25af559757 (76a8f08e-eac0-4b33-be06-0d25af559757): created successfully
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9dcb545-b1be-447c-b592-3f997fe17458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Flow 'volume_create_manager' (12032645-ee9e-4a62-8f3e-26b557d618f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f559a354-508c-485a-a693-4d424e9e476e tempest-VolumesTransfersTest-184081698 None] Created volume successfully.
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Acquiring lock "cinder-76a8f08e-eac0-4b33-be06-0d25af559757-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-76a8f08e-eac0-4b33-be06-0d25af559757-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Acquiring lock "cinder-quobyte-76a8f08e-eac0-4b33-be06-0d25af559757" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-quobyte-76a8f08e-eac0-4b33-be06-0d25af559757" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d4de87-017a-45c5-ad07-c2c45f169118]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:27 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757
Sep 25 18:32:27 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:27 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757" returned: 0 in 0.514s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:28 devstack sudo[95369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757
Sep 25 18:32:28 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:28 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76a8f08e-eac0-4b33-be06-0d25af559757" returned: 0 in 0.584s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-quobyte-76a8f08e-eac0-4b33-be06-0d25af559757" released by "delete_volume" :: held 1.177s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Created reservations ['d95f9035-c278-49d1-8670-be2d1312f23a', 'c2d49780-9c89-4480-a5bb-87965c9943eb', '8c4dc906-822f-4aba-adaf-e59c411419b8', '236cf82b-3e44-4dab-9d1c-384f2b1c694f'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:28 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:28 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:29 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.427s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Deleted volume successfully.
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-000fa058-e32c-4da8-9f54-d8fade416e6d tempest-VolumesTransfersTest-1993245679 None] Lock "cinder-76a8f08e-eac0-4b33-be06-0d25af559757-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "cinder-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "cinder-quobyte-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-quobyte-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9dc469-e774-4293-ab1c-cb89e1ef1c61]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:29 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1
Sep 25 18:32:29 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:30 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1" returned: 0 in 0.498s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:30 devstack sudo[95394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1
Sep 25 18:32:30 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Flow 'volume_create_manager' (f19d4efd-4af9-4358-85d5-21b399f6fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8535349-aa89-4df7-87d4-8050c512eeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8535349-aa89-4df7-87d4-8050c512eeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-518336148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325562ab-17af-47b5-85f6-d425cc4aedb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf708a7265a943fd8ee278677ecfffbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:30Z,use_quota=True,user_id='ae67c93ab0bd449793825c78ec5c8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5968effd-d38e-425f-94d0-bb34c403f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5968effd-d38e-425f-94d0-bb34c403f62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe72cb08-5fbf-43c3-8cec-9b3a7addfc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe72cb08-5fbf-43c3-8cec-9b3a7addfc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325562ab-17af-47b5-85f6-d425cc4aedb5', 'volume_name': 'volume-325562ab-17af-47b5-85f6-d425cc4aedb5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2a85a-6130-4af3-8326-5d14c84b1004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2a85a-6130-4af3-8326-5d14c84b1004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb4e2be-b122-4b50-9fe5-2e7bf8c241e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:30 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Volume 325562ab-17af-47b5-85f6-d425cc4aedb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325562ab-17af-47b5-85f6-d425cc4aedb5', 'volume_size': 1}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-518336148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325562ab-17af-47b5-85f6-d425cc4aedb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf708a7265a943fd8ee278677ecfffbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:30Z,use_quota=True,user_id='ae67c93ab0bd449793825c78ec5c8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Creating volume 325562ab-17af-47b5-85f6-d425cc4aedb5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:30 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:30 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5 1073741824
Sep 25 18:32:30 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:30 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-quobyte-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1" released by "delete_volume" :: held 0.878s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Created reservations ['2c99274a-8da7-41bc-bc17-e2520b8057c0', '976b9a1a-ba63-44f8-b4a4-b0d8c88c34ba', 'a09795d9-686e-456e-ae35-72010e013b28', 'c54b5a8b-4684-4cc7-8253-0c2ac59aed3e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:30 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:30 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "cinder-11c726c4-e529-4df0-8b7d-6e1d979b9bcc-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-11c726c4-e529-4df0-8b7d-6e1d979b9bcc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:30 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5 1073741824" returned: 0 in 0.646s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "cinder-quobyte-11c726c4-e529-4df0-8b7d-6e1d979b9bcc" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-quobyte-11c726c4-e529-4df0-8b7d-6e1d979b9bcc" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f5c275-9ec3-4055-8ef1-b94b22f2a127]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:31 devstack sudo[95425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5
Sep 25 18:32:31 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:31 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.484s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Deleted volume successfully.
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9ce5ed20-3d6e-4a47-b713-4da627a5b2af tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-405b1cbf-4c2b-460a-a7ba-eeb8f4c93ee1-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:31 devstack sudo[95427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc
Sep 25 18:32:31 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:31 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5" returned: 0 in 0.332s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb4e2be-b122-4b50-9fe5-2e7bf8c241e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325562ab-17af-47b5-85f6-d425cc4aedb5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdd51a5-49df-4e10-bb9e-9addd17b9fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:31 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Volume volume-325562ab-17af-47b5-85f6-d425cc4aedb5 (325562ab-17af-47b5-85f6-d425cc4aedb5): created successfully
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdd51a5-49df-4e10-bb9e-9addd17b9fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Flow 'volume_create_manager' (f19d4efd-4af9-4358-85d5-21b399f6fafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-dffd0776-6e9f-4452-9ae7-78f0e19d87f2 tempest-VolumesNegativeTest-412602881 None] Created volume successfully.
Sep 25 18:32:31 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc" returned: 0 in 0.477s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:31 devstack sudo[95443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc
Sep 25 18:32:31 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:31 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-11c726c4-e529-4df0-8b7d-6e1d979b9bcc" returned: 0 in 0.304s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-quobyte-11c726c4-e529-4df0-8b7d-6e1d979b9bcc" released by "delete_volume" :: held 0.855s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Created reservations ['bbcee002-b644-46c0-86ba-36115dd0029f', 'a7c9e949-f32c-4d1d-abd3-74ae8fb609cd', '76dd1329-5589-4253-a149-f356a4f0ede8', 'f72a36b0-b016-429a-b7ae-cfca212ac81a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:32 devstack sudo[95446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:32 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:32 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "cinder-248c1121-29e5-4a1a-86e2-872807527a7d-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.475s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Deleted volume successfully.
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-248c1121-29e5-4a1a-86e2-872807527a7d-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-76cfd734-b5c7-457d-8cf0-f134e3c6f839 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-11c726c4-e529-4df0-8b7d-6e1d979b9bcc-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "cinder-quobyte-248c1121-29e5-4a1a-86e2-872807527a7d" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-quobyte-248c1121-29e5-4a1a-86e2-872807527a7d" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7c4e04-7d46-4b23-a9dd-fe74b3036023]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:32 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d
Sep 25 18:32:32 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:33 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d" returned: 0 in 0.520s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:33 devstack sudo[95457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d
Sep 25 18:32:33 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:33 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-248c1121-29e5-4a1a-86e2-872807527a7d" returned: 0 in 0.708s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-quobyte-248c1121-29e5-4a1a-86e2-872807527a7d" released by "delete_volume" :: held 1.336s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Created reservations ['ac7b92a5-3246-48bf-a1d3-bee3afab092a', 'b8fecf61-bae9-4ccd-b0e1-8640317b65df', 'fe52d28b-05ef-4380-805b-dac4872c51bf', 'f4976883-4ae4-4082-b050-8fbeb9cf78ba'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:34 devstack sudo[95512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:34 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:34 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.501s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:34 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Deleted volume successfully.
Sep 25 18:32:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6e200dcf-c9da-466b-8c5c-8065c3285e50 tempest-AttachVolumeNegativeTest-1017368670 None] Lock "cinder-248c1121-29e5-4a1a-86e2-872807527a7d-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Flow 'volume_create_manager' (a00add77-69f9-4e61-8674-111cbc2d2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e87a6f-6be9-4ef6-a2a1-766071e6589b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e87a6f-6be9-4ef6-a2a1-766071e6589b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1219264531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582833ce-0402-4386-b5d2-1a092b37b3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975e5bd720554f358bc562dac1b8e6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:42Z,use_quota=True,user_id='cbe4ecb3840a4d2cab78acf4927742c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0d400f-d1b9-4865-9331-3877835a5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0d400f-d1b9-4865-9331-3877835a5c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7671c716-f7f5-4407-bf06-cd88230e5d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7671c716-f7f5-4407-bf06-cd88230e5d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582833ce-0402-4386-b5d2-1a092b37b3d6', 'volume_name': 'volume-582833ce-0402-4386-b5d2-1a092b37b3d6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1016b0fc-fefa-4414-9b9d-35e922541728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1016b0fc-fefa-4414-9b9d-35e922541728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e63e7e-5978-4283-9cc9-b95bf171f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Volume 582833ce-0402-4386-b5d2-1a092b37b3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582833ce-0402-4386-b5d2-1a092b37b3d6', 'volume_size': 1}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1219264531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582833ce-0402-4386-b5d2-1a092b37b3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975e5bd720554f358bc562dac1b8e6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:42Z,use_quota=True,user_id='cbe4ecb3840a4d2cab78acf4927742c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Creating volume 582833ce-0402-4386-b5d2-1a092b37b3d6 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:42 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:43 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6 1073741824
Sep 25 18:32:43 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:43 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6 1073741824" returned: 0 in 0.813s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:43 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6
Sep 25 18:32:43 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:44 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6" returned: 0 in 0.460s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:44 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:44 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e63e7e-5978-4283-9cc9-b95bf171f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582833ce-0402-4386-b5d2-1a092b37b3d6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe1e77d-599f-461b-bb5a-5278dc0e2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:44 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Volume volume-582833ce-0402-4386-b5d2-1a092b37b3d6 (582833ce-0402-4386-b5d2-1a092b37b3d6): created successfully
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe1e77d-599f-461b-bb5a-5278dc0e2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Flow 'volume_create_manager' (a00add77-69f9-4e61-8674-111cbc2d2231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9d2692d-80ab-4444-9eb3-2c8a1b65b70d tempest-VolumesTransfersV355Test-1705368808 None] Created volume successfully.
Sep 25 18:32:44 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.518s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:32:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:32:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-87f57fa0-3d2a-4f94-808d-5d83cc0c5bdc tempest-VolumesTransfersV355Test-131619734 None] Transfer volume completed successfully.
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Acquiring lock "cinder-582833ce-0402-4386-b5d2-1a092b37b3d6-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-582833ce-0402-4386-b5d2-1a092b37b3d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Acquiring lock "cinder-quobyte-582833ce-0402-4386-b5d2-1a092b37b3d6" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-quobyte-582833ce-0402-4386-b5d2-1a092b37b3d6" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65f402-86dd-4787-8cc5-98bd8932cf70]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Flow 'volume_create_manager' (479df5ae-055d-4f58-8abd-cc9915b1246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:48 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6
Sep 25 18:32:48 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebafc1cf-c0a5-4cef-93ba-5dd8861996ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebafc1cf-c0a5-4cef-93ba-5dd8861996ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2018590157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080b8cfb-6afe-4a77-8099-f973605f85ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba46cc374d447d9af6de9b4be526e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:49Z,use_quota=True,user_id='efb37403042c48bf8dae2764bf83b1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99908cb7-746d-4364-b80f-ac554d77f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99908cb7-746d-4364-b80f-ac554d77f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07da873-bd1c-4192-9c5b-a5f4280fcf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07da873-bd1c-4192-9c5b-a5f4280fcf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080b8cfb-6afe-4a77-8099-f973605f85ab', 'volume_name': 'volume-080b8cfb-6afe-4a77-8099-f973605f85ab', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82bc0f5-07e7-49c4-a714-1de1fb54177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82bc0f5-07e7-49c4-a714-1de1fb54177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e7c1fb-5d05-48fb-8042-fe7cf8f7e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Volume 080b8cfb-6afe-4a77-8099-f973605f85ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080b8cfb-6afe-4a77-8099-f973605f85ab', 'volume_size': 1}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2018590157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080b8cfb-6afe-4a77-8099-f973605f85ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba46cc374d447d9af6de9b4be526e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:49Z,use_quota=True,user_id='efb37403042c48bf8dae2764bf83b1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Creating volume 080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:49 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:49 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab 1073741824
Sep 25 18:32:49 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:49 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6" returned: 0 in 0.552s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:49 devstack sudo[95714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6
Sep 25 18:32:49 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:49 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-582833ce-0402-4386-b5d2-1a092b37b3d6" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-quobyte-582833ce-0402-4386-b5d2-1a092b37b3d6" released by "delete_volume" :: held 0.992s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:49 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab 1073741824" returned: 0 in 0.675s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Created reservations ['dfd742a8-091a-4bd9-9fa2-e8dd55c20c3a', 'fdaf8b6e-0593-4997-b099-406b8a175dc1', 'b84f57de-e273-4536-be61-ee7e0ca72298', '464ce5a0-f5d1-4a8a-b261-7279bd0b15af'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:49 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab
Sep 25 18:32:49 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:49 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:49 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:50 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab" returned: 0 in 0.333s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e7c1fb-5d05-48fb-8042-fe7cf8f7e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080b8cfb-6afe-4a77-8099-f973605f85ab', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7042a951-18f2-4cfa-9956-7b6b04415d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:50 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Volume volume-080b8cfb-6afe-4a77-8099-f973605f85ab (080b8cfb-6afe-4a77-8099-f973605f85ab): created successfully
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7042a951-18f2-4cfa-9956-7b6b04415d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Flow 'volume_create_manager' (479df5ae-055d-4f58-8abd-cc9915b1246e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-9031e7bb-e6a1-462f-9491-9ba034da637e req-d0803f62-4f6b-4d98-9515-24c10439be5c tempest-VolumesSnapshotsTestJSON-1535689506 None] Created volume successfully.
Sep 25 18:32:50 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Deleted volume successfully.
Sep 25 18:32:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96af3302-5ca7-4e98-b055-1b6d3e44088b tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-582833ce-0402-4386-b5d2-1a092b37b3d6-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Creating offline snapshot 788e32be-41e8-4849-83bf-427a8321fe64 of volume 080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[66df81da-ad92-4f0c-aebe-73b9ab4852ca]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Flow 'volume_create_manager' (2624d5f9-f4ca-4fd4-ae2b-2550b3e131ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:51 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab
Sep 25 18:32:51 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb41838-c55e-4dee-a861-209b2d1d9a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb41838-c55e-4dee-a861-209b2d1d9a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-527615545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2774dde-30ac-43f5-9bb8-c2868a86189f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975e5bd720554f358bc562dac1b8e6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:52Z,use_quota=True,user_id='cbe4ecb3840a4d2cab78acf4927742c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e213d85-a51b-44ab-b89b-f2922d4391d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e213d85-a51b-44ab-b89b-f2922d4391d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022e7104-d22f-4393-a166-bd720e2cd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022e7104-d22f-4393-a166-bd720e2cd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2774dde-30ac-43f5-9bb8-c2868a86189f', 'volume_name': 'volume-b2774dde-30ac-43f5-9bb8-c2868a86189f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234bb6d4-6dbc-42c3-a3e9-86d27cf41743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234bb6d4-6dbc-42c3-a3e9-86d27cf41743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a785da-506d-4d99-b3b4-ac47fd7b607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:51 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Volume b2774dde-30ac-43f5-9bb8-c2868a86189f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2774dde-30ac-43f5-9bb8-c2868a86189f', 'volume_size': 1}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:51 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab" returned: 0 in 0.492s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:51 devstack sudo[95732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 1G
Sep 25 18:32:51 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:52 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 1G" returned: 0 in 0.414s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080b8cfb-6afe-4a77-8099-f973605f85ab -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:52 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080b8cfb-6afe-4a77-8099-f973605f85ab -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64
Sep 25 18:32:52 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:52 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-080b8cfb-6afe-4a77-8099-f973605f85ab -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64" returned: 0 in 0.308s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:52 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 is being set with open permissions: ugo+rw
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:52 devstack sudo[95743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64
Sep 25 18:32:52 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:52 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=120,cinder:UPDATE=141,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=113,cinder:UPDATE=138,cinder:INSERT=39,cinder:DELETE=15 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:32:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:52 devstack sudo[95746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info
Sep 25 18:32:52 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:53 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:53 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info is being set with open permissions: ugo+rw
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:53 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info
Sep 25 18:32:53 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:53 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.info" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-527615545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2774dde-30ac-43f5-9bb8-c2868a86189f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975e5bd720554f358bc562dac1b8e6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:32:52Z,use_quota=True,user_id='cbe4ecb3840a4d2cab78acf4927742c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Creating volume b2774dde-30ac-43f5-9bb8-c2868a86189f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:32:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:53 devstack sudo[95753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f 1073741824
Sep 25 18:32:53 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-c87f3f80-6aea-4877-ae41-dea9aef6ee5c req-4c5160e6-6c04-4877-856e-45113781ca8e tempest-VolumesSnapshotsTestJSON-1535689506 None] Create snapshot completed successfully
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "cinder-788e32be-41e8-4849-83bf-427a8321fe64-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-788e32be-41e8-4849-83bf-427a8321fe64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "cinder-quobyte-080b8cfb-6afe-4a77-8099-f973605f85ab" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-quobyte-080b8cfb-6afe-4a77-8099-f973605f85ab" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "cinder-quobyte-788e32be-41e8-4849-83bf-427a8321fe64" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-quobyte-788e32be-41e8-4849-83bf-427a8321fe64" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Deleting offline snapshot 788e32be-41e8-4849-83bf-427a8321fe64 of volume 080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] snapshot_file for this snap is: volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:32:53 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f 1073741824" returned: 0 in 0.537s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d62f388-57bb-4318-94d7-f5e17fe198fd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:54 devstack sudo[95761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f
Sep 25 18:32:54 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:54 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64
Sep 25 18:32:54 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:54 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a785da-506d-4d99-b3b4-ac47fd7b607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2774dde-30ac-43f5-9bb8-c2868a86189f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07dcfdb-d93d-4be0-8639-a9360d0a85aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:32:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Volume volume-b2774dde-30ac-43f5-9bb8-c2868a86189f (b2774dde-30ac-43f5-9bb8-c2868a86189f): created successfully
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07dcfdb-d93d-4be0-8639-a9360d0a85aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Flow 'volume_create_manager' (2624d5f9-f4ca-4fd4-ae2b-2550b3e131ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:32:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a41819e7-dc22-49ef-b990-f97014b0ab6b tempest-VolumesTransfersV355Test-1705368808 None] Created volume successfully.
Sep 25 18:32:54 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64" returned: 0 in 0.396s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-080b8cfb-6afe-4a77-8099-f973605f85ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52d077-4c90-44af-a99b-1976722a7b94]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:54 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab
Sep 25 18:32:54 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:54 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab" returned: 0 in 0.401s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:54 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64
Sep 25 18:32:54 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Acquiring lock "cinder-b2774dde-30ac-43f5-9bb8-c2868a86189f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-b2774dde-30ac-43f5-9bb8-c2868a86189f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Acquiring lock "cinder-quobyte-b2774dde-30ac-43f5-9bb8-c2868a86189f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-quobyte-b2774dde-30ac-43f5-9bb8-c2868a86189f" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6886be-b697-4942-bff7-e32c7c8e6b18]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:55 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64" returned: 0 in 0.396s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:55 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64
Sep 25 18:32:55 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:55 devstack sudo[95779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f
Sep 25 18:32:55 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:55 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab.788e32be-41e8-4849-83bf-427a8321fe64" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-quobyte-788e32be-41e8-4849-83bf-427a8321fe64" released by "_delete_snapshot" :: held 1.585s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-quobyte-080b8cfb-6afe-4a77-8099-f973605f85ab" released by "delete_snapshot" :: held 1.615s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.quota [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Created reservations ['5c2af237-a89a-4aee-804c-7d5feb21b202', 'ca3d055f-2c9d-4008-9db3-19c37b420dab', '2998488c-7598-400e-bfe7-0b7eb1da8039', '27ab8faf-ca68-48be-bb9d-fa7f0d559562'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:55 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f" returned: 0 in 0.443s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:55 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f
Sep 25 18:32:55 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Delete snapshot completed successfully.
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-4f8d52c5-e707-4046-afc9-d6bd09544323 req-a13345fd-563b-4029-b135-93b15b6ad15a tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-788e32be-41e8-4849-83bf-427a8321fe64-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:55 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b2774dde-30ac-43f5-9bb8-c2868a86189f" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-quobyte-b2774dde-30ac-43f5-9bb8-c2868a86189f" released by "delete_volume" :: held 0.778s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:55 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Created reservations ['7a0697b2-06e3-41dd-b147-a65b49e1200e', '99ccb7e6-f167-4996-a4a6-a6156ca2c9eb', '0db36daf-02e6-4ae6-a227-4b9edb3c0662', '82ff91f5-9e8c-4094-9d44-8e63e29667ab'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:56 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:56 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "cinder-080b8cfb-6afe-4a77-8099-f973605f85ab-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-080b8cfb-6afe-4a77-8099-f973605f85ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "cinder-quobyte-080b8cfb-6afe-4a77-8099-f973605f85ab" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-quobyte-080b8cfb-6afe-4a77-8099-f973605f85ab" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[695c8f8b-9fec-4c73-a2b8-ea8c56f54b1c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:56 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab
Sep 25 18:32:56 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:56 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.475s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Deleted volume successfully.
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c8a44c1e-fee8-44a5-a087-f06329133c22 tempest-VolumesTransfersV355Test-352666186 None] Lock "cinder-b2774dde-30ac-43f5-9bb8-c2868a86189f-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:56 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab" returned: 0 in 0.544s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:56 devstack sudo[95799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab
Sep 25 18:32:56 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-080b8cfb-6afe-4a77-8099-f973605f85ab" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:57 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-quobyte-080b8cfb-6afe-4a77-8099-f973605f85ab" released by "delete_volume" :: held 1.095s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.quota [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Created reservations ['97ef3dee-add4-4ebb-ae54-2dd14f715031', '7fe03e84-05e4-4191-95bd-955080df2a03', '82ed8f65-0d51-40b4-91cc-a6fabbd4c187', 'cb0b55f5-c375-4c13-a69f-c64d1a4857f8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:57 devstack sudo[95802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:57 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Acquiring lock "cinder-325562ab-17af-47b5-85f6-d425cc4aedb5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Lock "cinder-325562ab-17af-47b5-85f6-d425cc4aedb5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:57 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.342s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.manager [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Deleted volume successfully.
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Acquiring lock "cinder-quobyte-325562ab-17af-47b5-85f6-d425cc4aedb5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:32:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-67312660-4d6e-4ff5-9033-ab474d0caa91 req-1acbf6ed-e690-472c-b230-94537452a272 tempest-VolumesSnapshotsTestJSON-1535689506 None] Lock "cinder-080b8cfb-6afe-4a77-8099-f973605f85ab-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Lock "cinder-quobyte-325562ab-17af-47b5-85f6-d425cc4aedb5" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0736bb-5607-47ec-89ba-92834d006c9f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:58 devstack sudo[95805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5
Sep 25 18:32:58 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:58 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5" returned: 0 in 0.374s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:58 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5
Sep 25 18:32:58 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:58 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-325562ab-17af-47b5-85f6-d425cc4aedb5" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Lock "cinder-quobyte-325562ab-17af-47b5-85f6-d425cc4aedb5" released by "delete_volume" :: held 0.768s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Created reservations ['fcfcd8d0-3f4a-4fca-bf85-1ca571eb0716', '34e12a45-010b-43f3-9448-5a4fbd1e0496', 'fa01dadf-f15d-46e0-82dd-23f60ee0f547', 'ac609bc3-34f4-491b-80bc-a2cf4a46b0f9'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:32:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:32:58 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:32:58 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:32:59 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Sep 25 18:32:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.421s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:32:59 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:32:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Deleted volume successfully.
Sep 25 18:32:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ca62316-8a0d-46b0-830b-8a67f8a7c67b tempest-VolumesNegativeTest-412602881 None] Lock "cinder-325562ab-17af-47b5-85f6-d425cc4aedb5-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Acquiring lock "cinder-19c6da39-9f8b-4da5-8eec-a58f664f482f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "cinder-19c6da39-9f8b-4da5-8eec-a58f664f482f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Acquiring lock "cinder-quobyte-19c6da39-9f8b-4da5-8eec-a58f664f482f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "cinder-quobyte-19c6da39-9f8b-4da5-8eec-a58f664f482f" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ce6e0-8e35-4549-94af-0df98923ef9a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:04 devstack sudo[95850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f
Sep 25 18:33:04 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:04 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f" returned: 0 in 0.421s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:04 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f
Sep 25 18:33:04 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5cceef14-48b9-4baf-a4b8-110f8e6bdf81 tempest-BackendsCapabilitiesAdminTestsJSON-2069425311 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2824325561523, 'free_capacity_gb': 1775.2824325561523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86534) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a491251a-a49b-42f3-a381-451f8f6fc23d tempest-BackendsCapabilitiesAdminTestsJSON-2069425311 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2824325561523, 'free_capacity_gb': 1775.2824325561523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86534) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 18:33:05 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-19c6da39-9f8b-4da5-8eec-a58f664f482f" returned: 0 in 0.376s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "cinder-quobyte-19c6da39-9f8b-4da5-8eec-a58f664f482f" released by "delete_volume" :: held 0.864s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Created reservations ['b0901bd5-994a-4a70-9e84-cc387f8e76b2', '6b6b16e2-71c5-4780-b374-85f27951750e', '7884c56d-e4bd-4da7-b8be-870f91ab815d', '1ea664de-aab7-40df-ae60-525e94ae9860'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:05 devstack sudo[95858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:33:05 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:05 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.307s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:33:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Deleted volume successfully.
Sep 25 18:33:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6aecbd4b-a66f-4da6-8544-4aed292e36c9 tempest-AttachVolumeShelveTestJSON-1021409735 None] Lock "cinder-19c6da39-9f8b-4da5-8eec-a58f664f482f-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Flow 'volume_create_manager' (6983ed0f-187f-4cd5-9676-bf6899284711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6bb842-e99c-4586-81b2-ee1d160489d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6bb842-e99c-4586-81b2-ee1d160489d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1992849555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334adeae-9c21-458e-9e08-b5259cb776d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fbc9d122084185ac403372a3db1895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:07Z,use_quota=True,user_id='012e37f3eba64d67b005bf011f72315a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a954441-c2f8-450f-8c23-346d17485d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a954441-c2f8-450f-8c23-346d17485d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb9c4e6-ebbd-42da-ad81-103d33666b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb9c4e6-ebbd-42da-ad81-103d33666b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334adeae-9c21-458e-9e08-b5259cb776d5', 'volume_name': 'volume-334adeae-9c21-458e-9e08-b5259cb776d5', 'volume_size': 2}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2503452d-693d-4141-8511-94bd56978209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2503452d-693d-4141-8511-94bd56978209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6a53ed-21b8-4e43-b3d2-cecd9512524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Volume 334adeae-9c21-458e-9e08-b5259cb776d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334adeae-9c21-458e-9e08-b5259cb776d5', 'volume_size': 2}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1992849555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334adeae-9c21-458e-9e08-b5259cb776d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0fbc9d122084185ac403372a3db1895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:07Z,use_quota=True,user_id='012e37f3eba64d67b005bf011f72315a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Creating volume 334adeae-9c21-458e-9e08-b5259cb776d5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:06 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5 2147483648 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:06 devstack sudo[95863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5 2147483648
Sep 25 18:33:06 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:07 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5 2147483648" returned: 0 in 0.580s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:07 devstack sudo[95871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5
Sep 25 18:33:07 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:07 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6a53ed-21b8-4e43-b3d2-cecd9512524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334adeae-9c21-458e-9e08-b5259cb776d5', 'volume_size': 2}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75a0cce-f512-475e-8f8f-2bb8c9a8a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Volume volume-334adeae-9c21-458e-9e08-b5259cb776d5 (334adeae-9c21-458e-9e08-b5259cb776d5): created successfully
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75a0cce-f512-475e-8f8f-2bb8c9a8a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Flow 'volume_create_manager' (6983ed0f-187f-4cd5-9676-bf6899284711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8f3689d1-93af-4182-9323-9aa3643ccc92 tempest-VolumesCloneNegativeTest-1148809933 None] Created volume successfully.
Sep 25 18:33:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Acquiring lock "cinder-334adeae-9c21-458e-9e08-b5259cb776d5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "cinder-334adeae-9c21-458e-9e08-b5259cb776d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Acquiring lock "cinder-quobyte-334adeae-9c21-458e-9e08-b5259cb776d5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "cinder-quobyte-334adeae-9c21-458e-9e08-b5259cb776d5" acquired by "delete_volume" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24c3c75-34e6-427d-b47a-d08473db8d7d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:09 devstack sudo[95875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5
Sep 25 18:33:09 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:09 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5" returned: 0 in 0.363s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:09 devstack sudo[95880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5
Sep 25 18:33:09 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:09 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-334adeae-9c21-458e-9e08-b5259cb776d5" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "cinder-quobyte-334adeae-9c21-458e-9e08-b5259cb776d5" released by "delete_volume" :: held 0.674s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Created reservations ['c7dd1648-6ebe-4700-a776-cfdad0363c58', 'bae9f225-d034-4bd7-9c97-2267fcc1cf96', '56d7a2e6-a304-4091-aefc-f7c6b5391685', '1ea1261e-2733-4971-86dd-fae42141aebc'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:09 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:33:09 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:10 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.492s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:10 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:33:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Deleted volume successfully.
Sep 25 18:33:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-67f1cd0d-33b1-46ea-b51a-1b09c00da0d3 tempest-VolumesCloneNegativeTest-1148809933 None] Lock "cinder-334adeae-9c21-458e-9e08-b5259cb776d5-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d8916743-d7cd-4ebc-b838-a4e6a671a8d9 tempest-GroupSnapshotsV319Test-138137249 None] Group tempest-GroupSnapshotsV319Test-Group-687405851: creating
Sep 25 18:33:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d8916743-d7cd-4ebc-b838-a4e6a671a8d9 tempest-GroupSnapshotsV319Test-138137249 None] Group tempest-GroupSnapshotsV319Test-Group-687405851: created successfully
Sep 25 18:33:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d8916743-d7cd-4ebc-b838-a4e6a671a8d9 tempest-GroupSnapshotsV319Test-138137249 None] Create group completed successfully.
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Flow 'volume_create_manager' (d370d43b-e571-448a-8c17-a505b1a6f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1008990-e565-4de8-99da-0f260b97e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1008990-e565-4de8-99da-0f260b97e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193089583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=caa819dd-d4d7-431e-8c87-cddfba597a7c,host='devstack@QuobyteHD#QuobyteHD',id=3512902d-ac55-4259-9370-1d90e3aca266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acf94f50a0d47b2879e543327414cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:20Z,use_quota=True,user_id='007a430c6a754b96ae8c1affd5d81bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e124e8dc-b15a-4b31-b622-c9a4a2e08def),volume_type_id=e124e8dc-b15a-4b31-b622-c9a4a2e08def)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce14cab-0bdb-413a-aa28-a0094d662372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce14cab-0bdb-413a-aa28-a0094d662372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba30c5d-9d1a-4942-9653-7a442898fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba30c5d-9d1a-4942-9653-7a442898fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3512902d-ac55-4259-9370-1d90e3aca266', 'volume_name': 'volume-3512902d-ac55-4259-9370-1d90e3aca266', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbc2419-5933-4f3b-9d47-500909722cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbc2419-5933-4f3b-9d47-500909722cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ea5e1-9f57-450a-b22f-faead2e3e362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:20 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Volume 3512902d-ac55-4259-9370-1d90e3aca266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3512902d-ac55-4259-9370-1d90e3aca266', 'volume_size': 1}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=caa819dd-d4d7-431e-8c87-cddfba597a7c,created_at=2026-09-25T16:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193089583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=caa819dd-d4d7-431e-8c87-cddfba597a7c,host='devstack@QuobyteHD#QuobyteHD',id=3512902d-ac55-4259-9370-1d90e3aca266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acf94f50a0d47b2879e543327414cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:20Z,use_quota=True,user_id='007a430c6a754b96ae8c1affd5d81bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e124e8dc-b15a-4b31-b622-c9a4a2e08def),volume_type_id=e124e8dc-b15a-4b31-b622-c9a4a2e08def)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Creating volume 3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:20 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:20 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 1073741824
Sep 25 18:33:20 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:21 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 1073741824" returned: 0 in 0.494s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:21 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266
Sep 25 18:33:21 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:21 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9ea5e1-9f57-450a-b22f-faead2e3e362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3512902d-ac55-4259-9370-1d90e3aca266', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca20051-25df-46da-953d-0a82a3f5d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:21 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Volume volume-3512902d-ac55-4259-9370-1d90e3aca266 (3512902d-ac55-4259-9370-1d90e3aca266): created successfully
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca20051-25df-46da-953d-0a82a3f5d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Flow 'volume_create_manager' (d370d43b-e571-448a-8c17-a505b1a6f83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-670e530b-d2a6-4d4f-ba52-d6dd2552780f tempest-GroupSnapshotsV319Test-138137249 None] Created volume successfully.
Sep 25 18:33:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] GroupSnapshot 9a6f6501-be98-4d01-b5ab-475b30f41cf4: creating.
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Group snapshot 9a6f6501-be98-4d01-b5ab-475b30f41cf4: creating. {{(pid=86534) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Creating offline snapshot a34596c7-9311-4492-809d-3db3c79c0906 of volume 3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cad537-ea50-4733-bdb8-9c7841e7ece3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:22 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266
Sep 25 18:33:22 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:22 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266" returned: 0 in 0.461s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:22 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 1G
Sep 25 18:33:22 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:23 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 1G" returned: 0 in 0.511s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3512902d-ac55-4259-9370-1d90e3aca266 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:23 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3512902d-ac55-4259-9370-1d90e3aca266 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906
Sep 25 18:33:23 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:23 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3512902d-ac55-4259-9370-1d90e3aca266 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:23 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:33:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:23 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906
Sep 25 18:33:23 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:23 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:23 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info
Sep 25 18:33:23 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:24 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info" returned: 0 in 0.402s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:24 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 25 18:33:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:24 devstack sudo[95919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info
Sep 25 18:33:24 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:24 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.info" returned: 0 in 0.293s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9470a18-4d08-4e00-8117-433f2b23a2e0 tempest-GroupSnapshotsV319Test-138137249 None] group_snapshot 9a6f6501-be98-4d01-b5ab-475b30f41cf4: created successfully
Sep 25 18:33:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] group_snapshot 9a6f6501-be98-4d01-b5ab-475b30f41cf4: deleting
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] group_snapshot 9a6f6501-be98-4d01-b5ab-475b30f41cf4: deleting {{(pid=86534) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "cinder-quobyte-3512902d-ac55-4259-9370-1d90e3aca266" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Lock "cinder-quobyte-3512902d-ac55-4259-9370-1d90e3aca266" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "cinder-quobyte-a34596c7-9311-4492-809d-3db3c79c0906" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Lock "cinder-quobyte-a34596c7-9311-4492-809d-3db3c79c0906" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Deleting offline snapshot a34596c7-9311-4492-809d-3db3c79c0906 of volume 3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] snapshot_file for this snap is: volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2c3699-49b3-4a51-8576-0ccf77f08320]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:26 devstack sudo[95959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906
Sep 25 18:33:26 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:26 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906" returned: 0 in 0.437s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3512902d-ac55-4259-9370-1d90e3aca266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:33:26 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[95714df3-34b3-43c4-b1a5-2a1250cc1dd1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:26 devstack sudo[95964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266
Sep 25 18:33:26 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:26 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266" returned: 0 in 0.420s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:26 devstack sudo[95969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906
Sep 25 18:33:26 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:27 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906" returned: 0 in 0.516s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:27 devstack sudo[95974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906
Sep 25 18:33:27 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:27 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266.a34596c7-9311-4492-809d-3db3c79c0906" returned: 0 in 0.305s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Lock "cinder-quobyte-a34596c7-9311-4492-809d-3db3c79c0906" released by "_delete_snapshot" :: held 1.829s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Lock "cinder-quobyte-3512902d-ac55-4259-9370-1d90e3aca266" released by "delete_snapshot" :: held 1.868s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:27 devstack cinder-volume[86534]: WARNING cinder.quota [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1147930480 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1147930480, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:33:27 devstack cinder-volume[86534]: WARNING cinder.quota [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1147930480 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1147930480, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:33:27 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] Created reservations ['17ea30b0-cd0a-4d9e-9bae-d0148cd5a28d', 'cd96edc4-5efa-4400-8627-b02c9958219f', '0c2dd207-e6d6-416d-8729-8bd20a3c5b29', '453136f9-3f52-4107-8eeb-3908d10a7879'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:33:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-10a4408c-cfdf-4b3c-a88c-ca1c06fe3906 tempest-GroupSnapshotsV319Test-138137249 None] group_snapshot 9a6f6501-be98-4d01-b5ab-475b30f41cf4: deleted successfully
Sep 25 18:33:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "cinder-quobyte-3512902d-ac55-4259-9370-1d90e3aca266" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Lock "cinder-quobyte-3512902d-ac55-4259-9370-1d90e3aca266" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec751250-2dfc-4427-83b0-dfc2d069fbc8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:28 devstack sudo[95977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266
Sep 25 18:33:28 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:29 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266" returned: 0 in 0.478s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:29 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266
Sep 25 18:33:29 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:29 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3512902d-ac55-4259-9370-1d90e3aca266" returned: 0 in 0.316s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Lock "cinder-quobyte-3512902d-ac55-4259-9370-1d90e3aca266" released by "delete_volume" :: held 0.913s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Created reservations ['c4a25903-8dbc-45ce-b113-ff2ef37ab584'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:33:29 devstack cinder-volume[86534]: WARNING cinder.quota [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1147930480 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1147930480, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Created reservations ['1a06e690-0ad2-4f98-a1a3-82b9eb2aec1a', 'a91bf715-d488-449d-9154-8a17aac044dd', '0d9613dd-3e71-42b2-9a26-2519c19a15a6', '9714fc69-9856-4910-bea3-59551789f8ab'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:29 devstack sudo[95987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:33:29 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:30 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.356s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:30 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:33:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9d63582-93ea-43e3-afd1-0a1fff2fa3a9 tempest-GroupSnapshotsV319Test-138137249 None] Delete group completed successfully.
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (b2be1747-1b0e-4b6f-895c-6a7c21d66a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b238591-5621-4493-aed6-f38da9c0dd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b238591-5621-4493-aed6-f38da9c0dd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1674084318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e15d894-09bd-458c-9c10-afab64b0f0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:35Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b7ab71-bc9f-4c19-8025-6bde7d345915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b7ab71-bc9f-4c19-8025-6bde7d345915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9c582b-f8eb-4c5a-a6e4-d206a280f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9c582b-f8eb-4c5a-a6e4-d206a280f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e15d894-09bd-458c-9c10-afab64b0f0a9', 'volume_name': 'volume-6e15d894-09bd-458c-9c10-afab64b0f0a9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25552f7-9100-43ca-b5bc-d96416088575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25552f7-9100-43ca-b5bc-d96416088575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39588924-2b9b-413b-bd5a-341cb9f805f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Volume 6e15d894-09bd-458c-9c10-afab64b0f0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e15d894-09bd-458c-9c10-afab64b0f0a9', 'volume_size': 1}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1674084318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e15d894-09bd-458c-9c10-afab64b0f0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:35Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Creating volume 6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:34 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:34 devstack sudo[95990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 1073741824
Sep 25 18:33:34 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:35 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 1073741824" returned: 0 in 0.592s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:35 devstack sudo[95996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9
Sep 25 18:33:35 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:35 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9" returned: 0 in 0.419s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39588924-2b9b-413b-bd5a-341cb9f805f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e15d894-09bd-458c-9c10-afab64b0f0a9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122955df-2855-4877-a3c5-371dcc17a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Volume volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 (6e15d894-09bd-458c-9c10-afab64b0f0a9): created successfully
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122955df-2855-4877-a3c5-371dcc17a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (b2be1747-1b0e-4b6f-895c-6a7c21d66a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b06e9e82-eb2d-4e94-8057-69db1319a24f tempest-VolumesSnapshotTestJSON-1687361518 None] Created volume successfully.
Sep 25 18:33:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating offline snapshot 6a998a3b-8068-4473-b874-170ab3b85466 of volume 6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:33:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a7e5d-b7c8-4950-8681-58d02b772ff5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:37 devstack sudo[95999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9
Sep 25 18:33:37 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:38 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9" returned: 0 in 0.726s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:38 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 1G
Sep 25 18:33:38 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:38 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 1G" returned: 0 in 0.617s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:38 devstack sudo[96011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466
Sep 25 18:33:38 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:39 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466" returned: 0 in 0.425s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:39 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 is being set with open permissions: ugo+rw
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:39 devstack sudo[96022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466
Sep 25 18:33:39 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Flow 'volume_create_manager' (e65a19be-7992-4be3-9c45-b79c9eda24c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:39 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0988f90a-64c9-498c-9bf7-3a0a55c5dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0988f90a-64c9-498c-9bf7-3a0a55c5dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-66281423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f263b50-2dda-40e6-8f7a-22fb21319d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d9197c8a6445c98ab57e018393c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:40Z,use_quota=True,user_id='843115cb84024ea3856579f4339ed794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de21686-cbd6-4ee8-a6fe-cf361c3572cd),volume_type_id=1de21686-cbd6-4ee8-a6fe-cf361c3572cd)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c9e342-1e71-427c-8d5d-e7362464a392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c9e342-1e71-427c-8d5d-e7362464a392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1309ed-9091-4200-baf5-8f8ef1dd5f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1309ed-9091-4200-baf5-8f8ef1dd5f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f263b50-2dda-40e6-8f7a-22fb21319d8a', 'volume_name': 'volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ef1cce-6daf-4c50-81a3-6c0e26e2efc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ef1cce-6daf-4c50-81a3-6c0e26e2efc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65dc88c-92bb-4e2e-aebb-2fd20cd9bbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:39 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Volume 6f263b50-2dda-40e6-8f7a-22fb21319d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a', 'volume_size': 1}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:39 devstack sudo[96025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info
Sep 25 18:33:39 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:40 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Flow 'volume_create_manager' (b3cb5681-fde9-4c77-8958-d9584afefbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3baacde-7f25-485e-8a9b-f240752d9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info" returned: 0 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:40 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info is being set with open permissions: ugo+rw
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:40 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info
Sep 25 18:33:40 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3baacde-7f25-485e-8a9b-f240752d9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-656525256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a47993-d50f-42f3-bfae-e796f3cc6929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d9197c8a6445c98ab57e018393c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:40Z,use_quota=True,user_id='843115cb84024ea3856579f4339ed794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e518094-b094-48e6-a4b9-8a28e629b10e),volume_type_id=1e518094-b094-48e6-a4b9-8a28e629b10e)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0b9ceb-ffea-4b83-b1c6-f0e585fba3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0b9ceb-ffea-4b83-b1c6-f0e585fba3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d275cb2a-1772-4766-811b-413dabc88c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d275cb2a-1772-4766-811b-413dabc88c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a47993-d50f-42f3-bfae-e796f3cc6929', 'volume_name': 'volume-25a47993-d50f-42f3-bfae-e796f3cc6929', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32dfca21-25df-45e9-a78f-a57073b1dead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32dfca21-25df-45e9-a78f-a57073b1dead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41f5941-d8a0-4dfd-ad28-4f4f4f081c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:40 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Volume 25a47993-d50f-42f3-bfae-e796f3cc6929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a47993-d50f-42f3-bfae-e796f3cc6929', 'volume_size': 1}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:40 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.info" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.101s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-66281423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f263b50-2dda-40e6-8f7a-22fb21319d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d9197c8a6445c98ab57e018393c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:40Z,use_quota=True,user_id='843115cb84024ea3856579f4339ed794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1de21686-cbd6-4ee8-a6fe-cf361c3572cd),volume_type_id=1de21686-cbd6-4ee8-a6fe-cf361c3572cd)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Creating volume 6f263b50-2dda-40e6-8f7a-22fb21319d8a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:40 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:40 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a 1073741824
Sep 25 18:33:40 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-743b4f79-4e1c-417f-a75f-188144d85a20 tempest-VolumesSnapshotTestJSON-1687361518 None] Create snapshot completed successfully
Sep 25 18:33:41 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a 1073741824" returned: 0 in 0.651s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:41 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a
Sep 25 18:33:41 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Flow 'volume_create_manager' (b94ba47c-0b2b-40b1-b6e8-52ea9319f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b35d351-408d-4607-8e24-c8c5ae2c9094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b35d351-408d-4607-8e24-c8c5ae2c9094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-444792499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c044867-a226-4f5a-b000-894f68676b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d9197c8a6445c98ab57e018393c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:42Z,use_quota=True,user_id='843115cb84024ea3856579f4339ed794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ac01b65-10ed-4748-96cf-87cd9dd7b4bd),volume_type_id=5ac01b65-10ed-4748-96cf-87cd9dd7b4bd)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7770e60-8d4d-4f22-9731-6d63805eb3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7770e60-8d4d-4f22-9731-6d63805eb3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f0a73e-eebb-4b16-baa4-08d8c7fb5eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:33:41 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a" returned: 0 in 0.385s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-656525256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a47993-d50f-42f3-bfae-e796f3cc6929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d9197c8a6445c98ab57e018393c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:40Z,use_quota=True,user_id='843115cb84024ea3856579f4339ed794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e518094-b094-48e6-a4b9-8a28e629b10e),volume_type_id=1e518094-b094-48e6-a4b9-8a28e629b10e)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Creating volume 25a47993-d50f-42f3-bfae-e796f3cc6929 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:41 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65dc88c-92bb-4e2e-aebb-2fd20cd9bbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77bb2af-c84d-4ce5-8be5-07326940736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:41 devstack sudo[96040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929 1073741824
Sep 25 18:33:41 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Volume volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a (6f263b50-2dda-40e6-8f7a-22fb21319d8a): created successfully
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77bb2af-c84d-4ce5-8be5-07326940736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Flow 'volume_create_manager' (e65a19be-7992-4be3-9c45-b79c9eda24c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-da4f00b3-96b5-43ee-8e11-760c92ee1d8a tempest-TestInstancesWithCinderVolumes-529216369 None] Created volume successfully.
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-6a998a3b-8068-4473-b874-170ab3b85466-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-6a998a3b-8068-4473-b874-170ab3b85466-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-6e15d894-09bd-458c-9c10-afab64b0f0a9" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6e15d894-09bd-458c-9c10-afab64b0f0a9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-6a998a3b-8068-4473-b874-170ab3b85466" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6a998a3b-8068-4473-b874-170ab3b85466" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleting offline snapshot 6a998a3b-8068-4473-b874-170ab3b85466 of volume 6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] snapshot_file for this snap is: volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d011ef7-24ee-4a33-a912-bbc9e9bc21dc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:42 devstack sudo[96045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466
Sep 25 18:33:42 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:42 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929 1073741824" returned: 0 in 0.659s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f0a73e-eebb-4b16-baa4-08d8c7fb5eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c044867-a226-4f5a-b000-894f68676b28', 'volume_name': 'volume-9c044867-a226-4f5a-b000-894f68676b28', 'volume_size': 1, 'image_id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a363e2fd-d831-4de6-8308-9057156ac64d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--761559613', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '195d9197c8a6445c98ab57e018393c77', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'created_at': datetime.datetime(2026, 9, 25, 16, 33, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 33, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a363e2fd-d831-4de6-8308-9057156ac64d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1badbb9e50>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a006576e-7ae4-4c5d-96ff-a162b7b2c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a006576e-7ae4-4c5d-96ff-a162b7b2c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f28ac3-577f-4e2f-82da-cff42b28342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Volume 9c044867-a226-4f5a-b000-894f68676b28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c044867-a226-4f5a-b000-894f68676b28', 'volume_size': 1, 'image_id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a363e2fd-d831-4de6-8308-9057156ac64d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--761559613', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '195d9197c8a6445c98ab57e018393c77', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'created_at': datetime.datetime(2026, 9, 25, 16, 33, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 33, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a363e2fd-d831-4de6-8308-9057156ac64d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1badbb9e50>}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Trying to clone 9c044867-a226-4f5a-b000-894f68676b28 from image a363e2fd-d831-4de6-8308-9057156ac64d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a363e2fd-d831-4de6-8308-9057156ac64d', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:42 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929
Sep 25 18:33:42 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:42 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466" returned: 0 in 0.496s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e15d894-09bd-458c-9c10-afab64b0f0a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c8029-5602-428a-9980-5d79ea8e85cf]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:42 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9
Sep 25 18:33:42 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:42 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929" returned: 0 in 0.434s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41f5941-d8a0-4dfd-ad28-4f4f4f081c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a47993-d50f-42f3-bfae-e796f3cc6929', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f111f8dc-de07-4dc1-8287-00be8f75013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:43 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Volume volume-25a47993-d50f-42f3-bfae-e796f3cc6929 (25a47993-d50f-42f3-bfae-e796f3cc6929): created successfully
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f111f8dc-de07-4dc1-8287-00be8f75013e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Flow 'volume_create_manager' (b3cb5681-fde9-4c77-8958-d9584afefbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e0ba7f81-5db6-46fb-ae50-06cf33580a5c tempest-TestInstancesWithCinderVolumes-529216369 None] Created volume successfully.
Sep 25 18:33:43 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9" returned: 0 in 0.449s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:43 devstack sudo[96059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466
Sep 25 18:33:43 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:43 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466" returned: 0 in 0.482s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:43 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466
Sep 25 18:33:43 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:44 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9.6a998a3b-8068-4473-b874-170ab3b85466" returned: 0 in 0.338s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:44 devstack sudo[96072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:33:44 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6a998a3b-8068-4473-b874-170ab3b85466" released by "_delete_snapshot" :: held 1.986s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6e15d894-09bd-458c-9c10-afab64b0f0a9" released by "delete_snapshot" :: held 2.020s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['76e2b174-355e-4d5f-bccb-c739167e1214', '58760414-0387-4786-abd6-c9fca919530c', '89b68459-885e-4dba-a5e4-4f39839784df', '8786945a-cfd7-4e4d-8608-cca08581d4bc'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:33:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Delete snapshot completed successfully.
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05242faf-3d48-48f4-9a42-2cecbc4374b6 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-6a998a3b-8068-4473-b874-170ab3b85466-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:33:44 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:33:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (25c75250-39e3-4025-b765-2bfb59918eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f238eb9-fc90-40e4-adaf-85a1e634f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f238eb9-fc90-40e4-adaf-85a1e634f441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-444488423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abf9b4d-6211-4b66-a9db-74e815060b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:46Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7f5cb5-4dff-48cf-a791-8938085a313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7f5cb5-4dff-48cf-a791-8938085a313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb3e6ce-1d8e-4361-8e7f-1620b858def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb3e6ce-1d8e-4361-8e7f-1620b858def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abf9b4d-6211-4b66-a9db-74e815060b8c', 'volume_name': 'volume-8abf9b4d-6211-4b66-a9db-74e815060b8c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d6c630-8865-41fe-b578-7b8e0f83f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d6c630-8865-41fe-b578-7b8e0f83f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fc7177-b12a-40c8-9de9-3475e32d96b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume 8abf9b4d-6211-4b66-a9db-74e815060b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abf9b4d-6211-4b66-a9db-74e815060b8c', 'volume_size': 1}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-444488423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abf9b4d-6211-4b66-a9db-74e815060b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:46Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating volume 8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:46 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:46 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c 1073741824
Sep 25 18:33:46 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:46 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c 1073741824" returned: 0 in 0.607s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:47 devstack sudo[96100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c
Sep 25 18:33:47 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:47 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fc7177-b12a-40c8-9de9-3475e32d96b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abf9b4d-6211-4b66-a9db-74e815060b8c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb97d5ec-720c-4235-b7f5-ca4bf967f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume volume-8abf9b4d-6211-4b66-a9db-74e815060b8c (8abf9b4d-6211-4b66-a9db-74e815060b8c): created successfully
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb97d5ec-720c-4235-b7f5-ca4bf967f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (25c75250-39e3-4025-b765-2bfb59918eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2a1cd724-afc3-4136-9845-d4a73b012977 tempest-VolumesSnapshotTestJSON-1687361518 None] Created volume successfully.
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD, size 20.69 MB, duration 5.22 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:33:47 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Image download 20.69 MB at 3.96 MB/s
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c3154-30cc-4e9c-ba93-92cab52e30e8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:47 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD
Sep 25 18:33:47 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:48 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Temporary image a363e2fd-d831-4de6-8308-9057156ac64d is fetched for user 843115cb84024ea3856579f4339ed794. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c6db08-d182-4ec9-9600-f182870e7e18]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:48 devstack sudo[96110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD
Sep 25 18:33:48 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating offline snapshot 6346b4a6-e73e-4546-841d-aa42e1c45934 of volume 8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d915c04d-c7ae-4b83-86e2-15dcebc8d71a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:48 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:49 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c
Sep 25 18:33:49 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:49 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c" returned: 0 in 0.843s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:49 devstack sudo[96173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 1G
Sep 25 18:33:49 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:50 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 1G" returned: 0 in 0.588s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abf9b4d-6211-4b66-a9db-74e815060b8c -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:50 devstack sudo[96204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abf9b4d-6211-4b66-a9db-74e815060b8c -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934
Sep 25 18:33:50 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:50 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abf9b4d-6211-4b66-a9db-74e815060b8c -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934" returned: 0 in 0.381s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:50 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 is being set with open permissions: ugo+rw
Sep 25 18:33:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:50 devstack sudo[96213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934
Sep 25 18:33:50 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:50 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934" returned: 0 in 0.293s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:51 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info
Sep 25 18:33:51 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:51 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info" returned: 0 in 0.315s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info is being set with open permissions: ugo+rw
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:51 devstack sudo[96221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info
Sep 25 18:33:51 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:51 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.info" returned: 0 in 0.439s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-444792499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c044867-a226-4f5a-b000-894f68676b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d9197c8a6445c98ab57e018393c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:42Z,use_quota=True,user_id='843115cb84024ea3856579f4339ed794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ac01b65-10ed-4748-96cf-87cd9dd7b4bd),volume_type_id=5ac01b65-10ed-4748-96cf-87cd9dd7b4bd)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Creating volume 9c044867-a226-4f5a-b000-894f68676b28 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:51 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:33:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:51 devstack sudo[96224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 1073741824
Sep 25 18:33:51 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:51 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f8b9c1ed-2dcb-4cbb-8bf6-8cee113e0b40 tempest-VolumesSnapshotTestJSON-1687361518 None] Create snapshot completed successfully
Sep 25 18:33:52 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 1073741824" returned: 0 in 0.592s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:52 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28
Sep 25 18:33:52 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:52 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Attempting download of a363e2fd-d831-4de6-8308-9057156ac64d ((None, [{'url': 'file:///opt/stack/data/glance/images/a363e2fd-d831-4de6-8308-9057156ac64d', 'metadata': {}}])) to volume 9c044867-a226-4f5a-b000-894f68676b28. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08472e3-29e3-4cf3-982e-11fda94501db]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:53 devstack sudo[96233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn
Sep 25 18:33:53 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:53 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn" returned: 0 in 0.459s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:53 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn
Sep 25 18:33:53 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:53 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn" returned: 1 in 0.449s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a363e2fd-d831-4de6-8308-9057156ac64d_1369wjvn' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e880d5-e3a6-4029-83e6-d65a94810053]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=99,cinder:DELETE=5,cinder:SELECT=91,cinder:INSERT=22 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=89,cinder:UPDATE=100,cinder:INSERT=28,cinder:DELETE=10 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:33:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (67a412fb-4797-4acf-828d-f0dea1f1f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8741916f-4c74-4596-abde-ce49849fda30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8741916f-4c74-4596-abde-ce49849fda30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-40002512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad505ccf-2f17-437b-b77d-e46832b0b293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:33:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6346b4a6-e73e-4546-841d-aa42e1c45934,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:33:54Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:54 devstack sudo[96242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD
Sep 25 18:33:54 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bf9240-8fdb-4043-bf89-8a8fd8090577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bf9240-8fdb-4043-bf89-8a8fd8090577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52e3f9b-d1f5-47a0-8cc3-beced3b821e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52e3f9b-d1f5-47a0-8cc3-beced3b821e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad505ccf-2f17-437b-b77d-e46832b0b293', 'volume_name': 'volume-ad505ccf-2f17-437b-b77d-e46832b0b293', 'volume_size': 2, 'snapshot_id': '6346b4a6-e73e-4546-841d-aa42e1c45934'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5804a8-bd69-4bb6-8d4c-4206813a5c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5804a8-bd69-4bb6-8d4c-4206813a5c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070b2f35-90fa-45d9-aabf-1897072c4911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:33:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Volume ad505ccf-2f17-437b-b77d-e46832b0b293: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad505ccf-2f17-437b-b77d-e46832b0b293', 'volume_size': 2, 'snapshot_id': '6346b4a6-e73e-4546-841d-aa42e1c45934'}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-6346b4a6-e73e-4546-841d-aa42e1c45934-ad505ccf-2f17-437b-b77d-e46832b0b293" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6346b4a6-e73e-4546-841d-aa42e1c45934-ad505ccf-2f17-437b-b77d-e46832b0b293" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Creating volume ad505ccf-2f17-437b-b77d-e46832b0b293 from snapshot 6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-ad505ccf-2f17-437b-b77d-e46832b0b293" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-ad505ccf-2f17-437b-b77d-e46832b0b293" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] snapshot: 6346b4a6-e73e-4546-841d-aa42e1c45934, volume: ad505ccf-2f17-437b-b77d-e46832b0b293,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f06aad-dadf-4735-b651-bf700e0a7488]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:54 devstack sudo[96245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934
Sep 25 18:33:54 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:54 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] a363e2fd-d831-4de6-8308-9057156ac64d was qcow2, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:54 devstack sudo[96252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28
Sep 25 18:33:54 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:54 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934" returned: 0 in 0.609s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abf9b4d-6211-4b66-a9db-74e815060b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9f3431-e60c-4c13-bca7-924964875beb]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:33:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:55 devstack sudo[96258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c
Sep 25 18:33:55 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:55 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c" returned: 0 in 0.666s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:33:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:33:55 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:33:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:55 devstack sudo[96268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293
Sep 25 18:33:55 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:33:59 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root
Sep 25 18:33:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28" returned: 0 in 4.720s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:33:59 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a363e2fd-d831-4de6-8308-9057156ac64d_67_210nxdevstack@QuobyteHD, size 112.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:33:59 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Converted 112.00 MB image at 23.72 MB/s
Sep 25 18:33:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:33:59 devstack sudo[96282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 1G
Sep 25 18:33:59 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:00 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 1G" returned: 0 in 0.890s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Downloaded image a363e2fd-d831-4de6-8308-9057156ac64d ((None, [{'url': 'file:///opt/stack/data/glance/images/a363e2fd-d831-4de6-8308-9057156ac64d', 'metadata': {}}])) to volume 9c044867-a226-4f5a-b000-894f68676b28 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Temporary image a363e2fd-d831-4de6-8308-9057156ac64d for user 843115cb84024ea3856579f4339ed794 is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Marking volume 9c044867-a226-4f5a-b000-894f68676b28 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Copying metadata from image a363e2fd-d831-4de6-8308-9057156ac64d to 9c044867-a226-4f5a-b000-894f68676b28. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Creating volume glance metadata for volume 9c044867-a226-4f5a-b000-894f68676b28 backed by image a363e2fd-d831-4de6-8308-9057156ac64d with: {'image_id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'image_name': 'tempest-scenario-img--761559613', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f28ac3-577f-4e2f-82da-cff42b28342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c044867-a226-4f5a-b000-894f68676b28', 'volume_size': 1, 'image_id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a363e2fd-d831-4de6-8308-9057156ac64d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--761559613', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '195d9197c8a6445c98ab57e018393c77', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a363e2fd-d831-4de6-8308-9057156ac64d', 'created_at': datetime.datetime(2026, 9, 25, 16, 33, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 33, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a363e2fd-d831-4de6-8308-9057156ac64d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1badbb9e50>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde78d15-526d-4929-82e7-78605656fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:00 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Volume volume-9c044867-a226-4f5a-b000-894f68676b28 (9c044867-a226-4f5a-b000-894f68676b28): created successfully
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde78d15-526d-4929-82e7-78605656fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Flow 'volume_create_manager' (b94ba47c-0b2b-40b1-b6e8-52ea9319f737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-79071433-1b55-440e-b364-3f5c3c79abb0 tempest-TestInstancesWithCinderVolumes-529216369 None] Created volume successfully.
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Flow 'volume_create_manager' (8ff81daf-7c4e-48f3-8d34-02f66c2209a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c6c856-f008-4df9-9743-5ad8035282a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c6c856-f008-4df9-9743-5ad8035282a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1683875389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b179f37d-63af-471a-9718-430545279d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5a2664e17c4b85b6d255e1c13adc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:06Z,use_quota=True,user_id='bb3a7468b550437a9e1b747be303a70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf390cf9-447b-434f-b82b-e4bc47ddb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf390cf9-447b-434f-b82b-e4bc47ddb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42565ca1-50f3-4fb8-9d3f-17cb42a93fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42565ca1-50f3-4fb8-9d3f-17cb42a93fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b179f37d-63af-471a-9718-430545279d07', 'volume_name': 'volume-b179f37d-63af-471a-9718-430545279d07', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f444c4-3396-46b2-ae03-b5357c3ca0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f444c4-3396-46b2-ae03-b5357c3ca0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e26ac6e-07b6-4d53-90ba-0671c5a0085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:05 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Volume b179f37d-63af-471a-9718-430545279d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b179f37d-63af-471a-9718-430545279d07', 'volume_size': 1}
Sep 25 18:34:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:06 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293" returned: 0 in 10.415s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c, size 1024.00 MB, duration 10.42 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:34:06 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Converted 1024.00 MB image at 98.31 MB/s
Sep 25 18:34:06 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 is being set with open permissions: ugo+rw
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:06 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293
Sep 25 18:34:06 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:06 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293" returned: 0 in 0.298s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-ad505ccf-2f17-437b-b77d-e46832b0b293" released by "_copy_volume_from_snapshot" :: held 12.148s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-159844a3-39ab-442b-ae6c-665904a0ed25 req-f0e38af1-462d-4885-b8a5-23754212d3c7 tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6346b4a6-e73e-4546-841d-aa42e1c45934-ad505ccf-2f17-437b-b77d-e46832b0b293" released by "_create_volume_from_snapshot" :: held 12.241s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.265s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1683875389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b179f37d-63af-471a-9718-430545279d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5a2664e17c4b85b6d255e1c13adc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:06Z,use_quota=True,user_id='bb3a7468b550437a9e1b747be303a70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Creating volume b179f37d-63af-471a-9718-430545279d07 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:06 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:06 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07 1073741824
Sep 25 18:34:06 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070b2f35-90fa-45d9-aabf-1897072c4911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad505ccf-2f17-437b-b77d-e46832b0b293', 'volume_size': 2, 'snapshot_id': '6346b4a6-e73e-4546-841d-aa42e1c45934'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bc1b3d-85bd-4dc5-8fd9-4ce5e290d570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Volume volume-ad505ccf-2f17-437b-b77d-e46832b0b293 (ad505ccf-2f17-437b-b77d-e46832b0b293): created successfully
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bc1b3d-85bd-4dc5-8fd9-4ce5e290d570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (67a412fb-4797-4acf-828d-f0dea1f1f543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-83e37547-3784-4864-aa4c-36a25d4c476d tempest-VolumesSnapshotTestJSON-1687361518 None] Created volume successfully.
Sep 25 18:34:06 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07 1073741824" returned: 0 in 0.514s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:07 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07
Sep 25 18:34:07 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:07 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-159844a3-39ab-442b-ae6c-665904a0ed25 req-f0e38af1-462d-4885-b8a5-23754212d3c7 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.864s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e26ac6e-07b6-4d53-90ba-0671c5a0085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b179f37d-63af-471a-9718-430545279d07', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d766b738-951d-450e-a9eb-9fdc69ef4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-159844a3-39ab-442b-ae6c-665904a0ed25 req-f0e38af1-462d-4885-b8a5-23754212d3c7 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Volume volume-b179f37d-63af-471a-9718-430545279d07 (b179f37d-63af-471a-9718-430545279d07): created successfully
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d766b738-951d-450e-a9eb-9fdc69ef4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Flow 'volume_create_manager' (8ff81daf-7c4e-48f3-8d34-02f66c2209a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-03b15b32-46bd-4eba-a1f7-1a130b278f47 tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Created volume successfully.
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-159844a3-39ab-442b-ae6c-665904a0ed25 req-f0e38af1-462d-4885-b8a5-23754212d3c7 tempest-TestInstancesWithCinderVolumes-529216369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-9c044867-a226-4f5a-b000-894f68676b28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2935d78e-7c47-43ac-862e-3f20b3940784', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:34:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-159844a3-39ab-442b-ae6c-665904a0ed25 req-f0e38af1-462d-4885-b8a5-23754212d3c7 tempest-TestInstancesWithCinderVolumes-529216369 None] attachment_update completed successfully.
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-ad505ccf-2f17-437b-b77d-e46832b0b293-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-ad505ccf-2f17-437b-b77d-e46832b0b293-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-ad505ccf-2f17-437b-b77d-e46832b0b293" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-ad505ccf-2f17-437b-b77d-e46832b0b293" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c283987f-1ace-4c77-ac67-4e30650ba6b9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:07 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293
Sep 25 18:34:07 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:08 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:08 devstack sudo[96362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293
Sep 25 18:34:08 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:08 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ad505ccf-2f17-437b-b77d-e46832b0b293" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-ad505ccf-2f17-437b-b77d-e46832b0b293" released by "delete_volume" :: held 0.795s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['d15ce179-2954-400d-adba-d70d2ff51332', '3cf5f19c-c3d1-406e-aae1-83afed893097', 'c0ff8fb1-0013-411f-8207-a8d2fdd92d1b', '1556e82a-fd7b-40cc-920e-6c733b932a8f'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:08 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:08 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-6346b4a6-e73e-4546-841d-aa42e1c45934-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-6346b4a6-e73e-4546-841d-aa42e1c45934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-8abf9b4d-6211-4b66-a9db-74e815060b8c" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-8abf9b4d-6211-4b66-a9db-74e815060b8c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-6346b4a6-e73e-4546-841d-aa42e1c45934" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6346b4a6-e73e-4546-841d-aa42e1c45934" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleting offline snapshot 6346b4a6-e73e-4546-841d-aa42e1c45934 of volume 8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] snapshot_file for this snap is: volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:34:09 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.413s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c0bb3-9aa0-4b3f-8eee-4367e9425162]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:09 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleted volume successfully.
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b806fc97-b500-4e48-a024-8c21f549c2c5 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-ad505ccf-2f17-437b-b77d-e46832b0b293-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:09 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934
Sep 25 18:34:09 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Acquiring lock "cinder-b179f37d-63af-471a-9718-430545279d07-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "cinder-b179f37d-63af-471a-9718-430545279d07-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Acquiring lock "cinder-quobyte-b179f37d-63af-471a-9718-430545279d07" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "cinder-quobyte-b179f37d-63af-471a-9718-430545279d07" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b4143e-0735-4863-adbb-db32a6f74234]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:09 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934" returned: 0 in 0.441s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abf9b4d-6211-4b66-a9db-74e815060b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[858397f3-8570-441b-bd0f-dd31a10b3d24]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:09 devstack sudo[96378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07
Sep 25 18:34:09 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:09 devstack sudo[96404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c
Sep 25 18:34:09 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:10 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07" returned: 0 in 0.508s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:10 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07
Sep 25 18:34:10 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:10 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b179f37d-63af-471a-9718-430545279d07" returned: 0 in 0.515s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:10 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c" returned: 0 in 0.936s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "cinder-quobyte-b179f37d-63af-471a-9718-430545279d07" released by "delete_volume" :: held 1.106s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:10 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934
Sep 25 18:34:10 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Created reservations ['1e263eaa-1104-4423-951f-3e3af75fb387', '81f21a6b-23c8-4b2a-870e-9db9dfb46a92', 'd037b4de-b831-4753-8736-70c26a43757b', '793731af-1650-453d-8127-05fb35207228'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:10 devstack sudo[96856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:10 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:11 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934" returned: 0 in 0.560s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:11 devstack sudo[96868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934
Sep 25 18:34:11 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:11 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Deleted volume successfully.
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e2551d2a-c460-4f77-b6bb-3e56c42e761d tempest-VolumeQuotasNegativeTestJSON-1989430127 None] Lock "cinder-b179f37d-63af-471a-9718-430545279d07-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:11 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c.6346b4a6-e73e-4546-841d-aa42e1c45934" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6346b4a6-e73e-4546-841d-aa42e1c45934" released by "_delete_snapshot" :: held 2.368s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-8abf9b4d-6211-4b66-a9db-74e815060b8c" released by "delete_snapshot" :: held 2.409s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['acd83219-a41a-465f-9886-d985d6fda417', '5a748080-9995-48c3-b524-6b966950c30f', '6d320902-0bb6-4b53-9c69-c7658ff87a91', '4c60f8d0-6010-4c06-847f-9aa0d340ae96'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Delete snapshot completed successfully.
Sep 25 18:34:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a105336d-a8d4-45d7-bb95-4410d3809b32 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-6346b4a6-e73e-4546-841d-aa42e1c45934-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-8abf9b4d-6211-4b66-a9db-74e815060b8c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-8abf9b4d-6211-4b66-a9db-74e815060b8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-8abf9b4d-6211-4b66-a9db-74e815060b8c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-8abf9b4d-6211-4b66-a9db-74e815060b8c" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a35652-b808-46bc-b555-be8ed94b1df7]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:12 devstack sudo[96891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c
Sep 25 18:34:12 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:13 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c" returned: 0 in 0.693s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:13 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c
Sep 25 18:34:13 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:13 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8abf9b4d-6211-4b66-a9db-74e815060b8c" returned: 0 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-8abf9b4d-6211-4b66-a9db-74e815060b8c" released by "delete_volume" :: held 1.141s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['0e71a3fc-31ac-4469-bd52-153f97902d28', '545655d5-b889-492e-af5d-d94348c21fac', '2a6e27c7-a939-40e6-bd00-c2212a10ce34', '3fc5d1f5-9d7c-4a4a-b350-ee08252b1b48'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:13 devstack sudo[96902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:13 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:14 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:14 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:14 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleted volume successfully.
Sep 25 18:34:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2926e8cf-2c7d-49c8-a45d-9dea3d9b18a2 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-8abf9b4d-6211-4b66-a9db-74e815060b8c-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (64b8626f-90ff-490d-9cce-1b9196b6984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e7c56a-1b5e-4c41-962d-b7de2303da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Flow 'volume_create_manager' (9f2e9a16-3d52-44fd-b01d-1661f2dec65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3118b6c3-9666-4a3e-a134-19847812db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e7c56a-1b5e-4c41-962d-b7de2303da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-115019802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a575a3-d399-4040-b299-d4684d6f6e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:16Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8209b27e-6f9f-4a7f-884a-0ca4e384cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8209b27e-6f9f-4a7f-884a-0ca4e384cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a348b2c-d092-458d-b1fb-578e33499b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a348b2c-d092-458d-b1fb-578e33499b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0a575a3-d399-4040-b299-d4684d6f6e17', 'volume_name': 'volume-f0a575a3-d399-4040-b299-d4684d6f6e17', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216b142f-4a7f-4a8a-8d21-53cbd5d477a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216b142f-4a7f-4a8a-8d21-53cbd5d477a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b11895-b237-4d12-9f07-ef66832e4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:15 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume f0a575a3-d399-4040-b299-d4684d6f6e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0a575a3-d399-4040-b299-d4684d6f6e17', 'volume_size': 1}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-115019802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a575a3-d399-4040-b299-d4684d6f6e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:16Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating volume f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:15 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:34:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3118b6c3-9666-4a3e-a134-19847812db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-314500764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4d4c8-d94c-488d-8cc7-af48c4a9616e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfe4587134d4c9b829de7cfd4eec2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:16Z,use_quota=True,user_id='66f76eedc6de44ce9723c444cc63b29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffb4b96-c5f4-43f2-ad3f-fbd6684477f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffb4b96-c5f4-43f2-ad3f-fbd6684477f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:16 devstack sudo[96913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 1073741824
Sep 25 18:34:16 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b975c9ca-58a9-4b7f-971d-01603b59eba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b975c9ca-58a9-4b7f-971d-01603b59eba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d4d4c8-d94c-488d-8cc7-af48c4a9616e', 'volume_name': 'volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7975865b-f2e9-4717-9721-826562e1a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7975865b-f2e9-4717-9721-826562e1a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67b9c35-030b-4bae-8a7e-f687d629584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:16 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Volume 75d4d4c8-d94c-488d-8cc7-af48c4a9616e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e', 'volume_size': 1}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:16 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 1073741824" returned: 0 in 0.706s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:16 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17
Sep 25 18:34:16 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:17 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17" returned: 0 in 0.348s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-314500764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4d4c8-d94c-488d-8cc7-af48c4a9616e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfe4587134d4c9b829de7cfd4eec2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:16Z,use_quota=True,user_id='66f76eedc6de44ce9723c444cc63b29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Creating volume 75d4d4c8-d94c-488d-8cc7-af48c4a9616e {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:17 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:17 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e 1073741824
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b11895-b237-4d12-9f07-ef66832e4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0a575a3-d399-4040-b299-d4684d6f6e17', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:17 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7c2294-4886-4f9c-8fdc-5796ab75a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:17 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume volume-f0a575a3-d399-4040-b299-d4684d6f6e17 (f0a575a3-d399-4040-b299-d4684d6f6e17): created successfully
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7c2294-4886-4f9c-8fdc-5796ab75a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (64b8626f-90ff-490d-9cce-1b9196b6984c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9e85db1f-bf09-47b8-ad09-a468b4b91e36 tempest-VolumesSnapshotTestJSON-1687361518 None] Created volume successfully.
Sep 25 18:34:17 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e 1073741824" returned: 0 in 0.724s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:17 devstack sudo[96927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e
Sep 25 18:34:17 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:18 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e" returned: 0 in 0.481s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.244s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67b9c35-030b-4bae-8a7e-f687d629584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b447493-e542-45fe-86ea-e7141af4a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:18 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Volume volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e (75d4d4c8-d94c-488d-8cc7-af48c4a9616e): created successfully
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b447493-e542-45fe-86ea-e7141af4a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Flow 'volume_create_manager' (9f2e9a16-3d52-44fd-b01d-1661f2dec65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating offline snapshot f4cf099e-96e5-4301-9ff0-b163db4d09d8 of volume f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:34:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d7c01322-6266-447d-97a0-fd86f9538b94 tempest-AttachVolumeTestJSON-556297169 None] Created volume successfully.
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ad472-b9d1-4347-a374-a78480a7984b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:18 devstack sudo[96931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17
Sep 25 18:34:18 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:19 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17" returned: 0 in 0.932s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:19 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 1G
Sep 25 18:34:19 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:20 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 1G" returned: 0 in 0.891s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a575a3-d399-4040-b299-d4684d6f6e17 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c459ce0e-22f5-4090-97a3-0f193015e727 req-9a377ef1-060f-4f83-8e35-5f80f7ab4324 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:20 devstack sudo[96958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a575a3-d399-4040-b299-d4684d6f6e17 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8
Sep 25 18:34:20 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:20 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a575a3-d399-4040-b299-d4684d6f6e17 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8" returned: 0 in 0.590s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:20 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 is being set with open permissions: ugo+rw
Sep 25 18:34:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:20 devstack sudo[96964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8
Sep 25 18:34:20 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:21 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:21 devstack sudo[96967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info
Sep 25 18:34:21 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:21 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info" returned: 0 in 0.347s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:21 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info is being set with open permissions: ugo+rw
Sep 25 18:34:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:21 devstack sudo[96970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info
Sep 25 18:34:21 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:22 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.info" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.698s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c459ce0e-22f5-4090-97a3-0f193015e727 req-9a377ef1-060f-4f83-8e35-5f80f7ab4324 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.696s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c459ce0e-22f5-4090-97a3-0f193015e727 req-9a377ef1-060f-4f83-8e35-5f80f7ab4324 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c8622ddd-1adc-4395-a92b-9350a47de283 tempest-VolumesSnapshotTestJSON-1687361518 None] Create snapshot completed successfully
Sep 25 18:34:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-c459ce0e-22f5-4090-97a3-0f193015e727 req-9a377ef1-060f-4f83-8e35-5f80f7ab4324 tempest-AttachVolumeTestJSON-556297169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eac175a5-4ecd-44d4-ba0c-c1d60406b74b', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:34:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-c459ce0e-22f5-4090-97a3-0f193015e727 req-9a377ef1-060f-4f83-8e35-5f80f7ab4324 tempest-AttachVolumeTestJSON-556297169 None] attachment_update completed successfully.
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (0fd7b0d0-31f8-4103-96dc-4408ca8b460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cecf05c-e7bc-445e-b789-a51e2b457bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cecf05c-e7bc-445e-b789-a51e2b457bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1818854706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30d2fe-b7f1-47cb-ac7d-0dee905b3147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1426df9b04b598e61e495cccdac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4cf099e-96e5-4301-9ff0-b163db4d09d8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:24Z,use_quota=True,user_id='a32c07f4aca0407795c860fb897ffa84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551ffd80-6a74-4dd0-8978-d49718da3a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551ffd80-6a74-4dd0-8978-d49718da3a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02f062d-a60f-4579-bfe5-04151f3979fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02f062d-a60f-4579-bfe5-04151f3979fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e30d2fe-b7f1-47cb-ac7d-0dee905b3147', 'volume_name': 'volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147', 'volume_size': 1, 'snapshot_id': 'f4cf099e-96e5-4301-9ff0-b163db4d09d8'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af85246f-0e39-416e-ba2e-faf366f5dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af85246f-0e39-416e-ba2e-faf366f5dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ff66b4-c888-4978-9b82-05bf8ea55b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:23 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume 3e30d2fe-b7f1-47cb-ac7d-0dee905b3147: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147', 'volume_size': 1, 'snapshot_id': 'f4cf099e-96e5-4301-9ff0-b163db4d09d8'}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-f4cf099e-96e5-4301-9ff0-b163db4d09d8-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f4cf099e-96e5-4301-9ff0-b163db4d09d8-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating volume 3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 from snapshot f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] snapshot: f4cf099e-96e5-4301-9ff0-b163db4d09d8, volume: 3e30d2fe-b7f1-47cb-ac7d-0dee905b3147,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30c7b8-a30b-4ec6-b987-bac6bc782a3f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:24 devstack sudo[96978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8
Sep 25 18:34:24 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:24 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8" returned: 0 in 0.758s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0a575a3-d399-4040-b299-d4684d6f6e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:34:24 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c72985-a295-42ed-887e-8036d4804790]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:24 devstack sudo[96984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17
Sep 25 18:34:24 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:25 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17" returned: 0 in 0.549s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:34:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:34:25 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:34:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:25 devstack sudo[97027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147
Sep 25 18:34:25 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:33 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=53,cinder:UPDATE=46,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:34:33 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=52,cinder:INSERT=10,cinder:UPDATE=50,cinder:DELETE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:34:36 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" returned: 0 in 10.720s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17, size 1024.00 MB, duration 10.72 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:34:36 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Converted 1024.00 MB image at 95.51 MB/s
Sep 25 18:34:36 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 is being set with open permissions: ugo+rw
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:36 devstack sudo[97199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147
Sep 25 18:34:36 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:36 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" returned: 0 in 0.368s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" released by "_copy_volume_from_snapshot" :: held 12.544s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f4cf099e-96e5-4301-9ff0-b163db4d09d8-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" released by "_create_volume_from_snapshot" :: held 12.623s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.641s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ff66b4-c888-4978-9b82-05bf8ea55b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147', 'volume_size': 1, 'snapshot_id': 'f4cf099e-96e5-4301-9ff0-b163db4d09d8'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9312f9cb-6e82-4326-ab5f-6ac0d3ffa906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Volume volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 (3e30d2fe-b7f1-47cb-ac7d-0dee905b3147): created successfully
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9312f9cb-6e82-4326-ab5f-6ac0d3ffa906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Flow 'volume_create_manager' (0fd7b0d0-31f8-4103-96dc-4408ca8b460a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ddf23d33-4ddf-4432-bea8-087283684931 tempest-VolumesSnapshotTestJSON-1687361518 None] Created volume successfully.
Sep 25 18:34:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7781bcfb-bf56-424c-8fe8-b3edc10b0339]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:37 devstack sudo[97204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147
Sep 25 18:34:37 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:38 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" returned: 0 in 0.409s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:38 devstack sudo[97210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147
Sep 25 18:34:38 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:38 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147" released by "delete_volume" :: held 0.732s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['4467297d-149c-4189-abdd-3b27ad6f6b5f', '698d732c-cffd-4dce-b045-46cfc8283d21', '3b1ea5b9-37f3-4f32-bf10-2361fbc62a00', '98450701-16eb-41a6-85ad-5483129ac044'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:38 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:38 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Flow 'volume_create_manager' (bb904832-0c17-4ef6-996b-1b09c05edf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bda895-6967-4eee-ab63-1b94b280b093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bda895-6967-4eee-ab63-1b94b280b093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1418299313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68561401-ba04-4c12-974b-05355ff7369c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412a8ad24f4f4d329d5100e4eccf4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:39Z,use_quota=True,user_id='aa82b3aaab2d4eae93a536c7e9a2c2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0584e805-05ef-4629-bfbe-bb9807848bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0584e805-05ef-4629-bfbe-bb9807848bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da8f72-ecb4-4119-b369-d83121712aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da8f72-ecb4-4119-b369-d83121712aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68561401-ba04-4c12-974b-05355ff7369c', 'volume_name': 'volume-68561401-ba04-4c12-974b-05355ff7369c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790629cf-b436-47ff-af91-19a45d335f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790629cf-b436-47ff-af91-19a45d335f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261144f3-335b-474e-8a35-117867cadd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Volume 68561401-ba04-4c12-974b-05355ff7369c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68561401-ba04-4c12-974b-05355ff7369c', 'volume_size': 1}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1418299313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68561401-ba04-4c12-974b-05355ff7369c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412a8ad24f4f4d329d5100e4eccf4f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:39Z,use_quota=True,user_id='aa82b3aaab2d4eae93a536c7e9a2c2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Creating volume 68561401-ba04-4c12-974b-05355ff7369c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:38 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:38 devstack sudo[97215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c 1073741824
Sep 25 18:34:38 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-f4cf099e-96e5-4301-9ff0-b163db4d09d8-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-f4cf099e-96e5-4301-9ff0-b163db4d09d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-f0a575a3-d399-4040-b299-d4684d6f6e17" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.348s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:38 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Deleted volume successfully.
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f0a575a3-d399-4040-b299-d4684d6f6e17" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-f4cf099e-96e5-4301-9ff0-b163db4d09d8" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f4cf099e-96e5-4301-9ff0-b163db4d09d8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleting offline snapshot f4cf099e-96e5-4301-9ff0-b163db4d09d8 of volume f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] snapshot_file for this snap is: volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62122803-4606-4516-b9c2-cfd5d2bbd62e tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-3e30d2fe-b7f1-47cb-ac7d-0dee905b3147-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7689981d-0b05-4f64-b7e5-01a7744cf712]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:39 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8
Sep 25 18:34:39 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:39 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c 1073741824" returned: 0 in 0.545s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:39 devstack sudo[97231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c
Sep 25 18:34:39 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:39 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8" returned: 0 in 0.411s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0a575a3-d399-4040-b299-d4684d6f6e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29de62-5bb5-4d0d-bf91-e6160419dc12]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:39 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17
Sep 25 18:34:39 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:39 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c" returned: 0 in 0.331s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261144f3-335b-474e-8a35-117867cadd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68561401-ba04-4c12-974b-05355ff7369c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9097ab-c5ee-4a36-8ad0-15e6392b86a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:39 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Volume volume-68561401-ba04-4c12-974b-05355ff7369c (68561401-ba04-4c12-974b-05355ff7369c): created successfully
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9097ab-c5ee-4a36-8ad0-15e6392b86a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Flow 'volume_create_manager' (bb904832-0c17-4ef6-996b-1b09c05edf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-42e75266-bb9c-49b1-bc0f-b40ff03bd6a2 tempest-VolumesMetadataTest-265820430 None] Created volume successfully.
Sep 25 18:34:40 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17" returned: 0 in 0.707s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:40 devstack sudo[97242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8
Sep 25 18:34:40 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:40 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8" returned: 0 in 0.326s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:40 devstack sudo[97247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8
Sep 25 18:34:40 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:40 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17.f4cf099e-96e5-4301-9ff0-b163db4d09d8" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f4cf099e-96e5-4301-9ff0-b163db4d09d8" released by "_delete_snapshot" :: held 1.851s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f0a575a3-d399-4040-b299-d4684d6f6e17" released by "delete_snapshot" :: held 1.896s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:40 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['4311185f-c0d2-4501-9348-b9f26b1cf2ee', 'd9d7d99b-3f5a-4fdf-93d2-ec4f2c5c4c54', 'a9bd6b0b-44b5-4a3a-8daa-a204008436f1', '13a4b9b2-5bb5-409f-81ad-ac5c543c24da'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Delete snapshot completed successfully.
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-b4307dca-d0e0-4287-956b-4adc4f389c26 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-f4cf099e-96e5-4301-9ff0-b163db4d09d8-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-f0a575a3-d399-4040-b299-d4684d6f6e17-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-f0a575a3-d399-4040-b299-d4684d6f6e17-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-f0a575a3-d399-4040-b299-d4684d6f6e17" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f0a575a3-d399-4040-b299-d4684d6f6e17" acquired by "delete_volume" :: waited 0.036s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5656a91-bad8-47a0-b072-8c5212ba877c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:41 devstack sudo[97250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17
Sep 25 18:34:41 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Acquiring lock "cinder-68561401-ba04-4c12-974b-05355ff7369c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Lock "cinder-68561401-ba04-4c12-974b-05355ff7369c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Acquiring lock "cinder-quobyte-68561401-ba04-4c12-974b-05355ff7369c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Lock "cinder-quobyte-68561401-ba04-4c12-974b-05355ff7369c" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d55e67f-b383-498c-8a7f-16e58728ce2b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:41 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17" returned: 0 in 0.488s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:41 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17
Sep 25 18:34:41 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:41 devstack sudo[97255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c
Sep 25 18:34:41 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:42 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f0a575a3-d399-4040-b299-d4684d6f6e17" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-f0a575a3-d399-4040-b299-d4684d6f6e17" released by "delete_volume" :: held 0.826s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['515818e5-ba41-4e35-84b6-f9134f8648bd', '5491fc3d-defb-488a-b5f9-566ae6ff936b', '49b79b4d-9632-444f-9f7e-cae4084faaf4', '186fb18f-3e29-4cd3-bc48-7efec50703e7'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:42 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:42 devstack sudo[97275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:42 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:42 devstack sudo[97277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:42 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-6e15d894-09bd-458c-9c10-afab64b0f0a9-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-6e15d894-09bd-458c-9c10-afab64b0f0a9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "cinder-quobyte-6e15d894-09bd-458c-9c10-afab64b0f0a9" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6e15d894-09bd-458c-9c10-afab64b0f0a9" acquired by "delete_volume" :: waited 0.046s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:42 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-68561401-ba04-4c12-974b-05355ff7369c" returned: 0 in 0.437s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24f586-4836-4ab8-b6d6-d3e175e05bba]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Lock "cinder-quobyte-68561401-ba04-4c12-974b-05355ff7369c" released by "delete_volume" :: held 0.958s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Created reservations ['7bc961b1-e59a-49ee-8df1-cb7c7d7e4e97', '143211f9-774b-4241-8ea1-f35aee7afc78', 'c4d40e98-26ec-43bb-bbe7-a6fefc4144f1', '7727906f-4724-4216-8f08-4d638c935bb7'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:42 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.520s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleted volume successfully.
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-34a04e75-4748-4db0-82f8-02c07d6c39f1 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-f0a575a3-d399-4040-b299-d4684d6f6e17-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:42 devstack sudo[97280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9
Sep 25 18:34:42 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:43 devstack sudo[97283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:43 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:43 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9" returned: 0 in 0.543s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:43 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:43 devstack sudo[97290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.344s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:43 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Deleted volume successfully.
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-acd9aef4-b45e-461a-be5b-6ad6b09d6685 tempest-VolumesMetadataTest-265820430 None] Lock "cinder-68561401-ba04-4c12-974b-05355ff7369c-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:43 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6e15d894-09bd-458c-9c10-afab64b0f0a9" returned: 0 in 0.273s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-quobyte-6e15d894-09bd-458c-9c10-afab64b0f0a9" released by "delete_volume" :: held 0.908s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Created reservations ['42ff75ab-287d-4059-959c-ad6e3cd54dcf', '80e8ba64-b1f9-4295-9625-b01626281f0f', 'fc92a22d-a349-4d23-9795-b26a15245ce4', '3e9070b2-ae52-49b9-8556-a1458b927dc0'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:43 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:43 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:43 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:43 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Deleted volume successfully.
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3bc54645-c63d-44a2-914e-650710667978 tempest-VolumesSnapshotTestJSON-1687361518 None] Lock "cinder-6e15d894-09bd-458c-9c10-afab64b0f0a9-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:44 devstack sudo[97296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:34:44 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:44 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.410s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:34:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:34:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-09f75b71-1e62-40c9-b6b1-de7dae5227ad req-13b1785e-1bdb-4540-a3b8-f2831eb81c01 tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-09f75b71-1e62-40c9-b6b1-de7dae5227ad req-13b1785e-1bdb-4540-a3b8-f2831eb81c01 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-09f75b71-1e62-40c9-b6b1-de7dae5227ad req-13b1785e-1bdb-4540-a3b8-f2831eb81c01 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-09f75b71-1e62-40c9-b6b1-de7dae5227ad req-13b1785e-1bdb-4540-a3b8-f2831eb81c01 tempest-TestInstancesWithCinderVolumes-529216369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '137b3144-f7db-49ea-8f7c-f500d6280504', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:34:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-09f75b71-1e62-40c9-b6b1-de7dae5227ad req-13b1785e-1bdb-4540-a3b8-f2831eb81c01 tempest-TestInstancesWithCinderVolumes-529216369 None] attachment_update completed successfully.
Sep 25 18:34:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-2d2d807d-2496-44be-a9db-adde23fe4024 req-3ac5f805-8f62-40cd-a81e-26cfbff7ba68 tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-2d2d807d-2496-44be-a9db-adde23fe4024 req-3ac5f805-8f62-40cd-a81e-26cfbff7ba68 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-2d2d807d-2496-44be-a9db-adde23fe4024 req-3ac5f805-8f62-40cd-a81e-26cfbff7ba68 tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-2d2d807d-2496-44be-a9db-adde23fe4024 req-3ac5f805-8f62-40cd-a81e-26cfbff7ba68 tempest-TestInstancesWithCinderVolumes-529216369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-25a47993-d50f-42f3-bfae-e796f3cc6929', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '951cc895-620e-4723-9ca3-9527530f68a0', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:34:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-2d2d807d-2496-44be-a9db-adde23fe4024 req-3ac5f805-8f62-40cd-a81e-26cfbff7ba68 tempest-TestInstancesWithCinderVolumes-529216369 None] attachment_update completed successfully.
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Flow 'volume_create_manager' (a4591c44-2de0-4397-a1d5-b809ba811ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282e36a8-e843-4b67-85a6-ffac6d96dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282e36a8-e843-4b67-85a6-ffac6d96dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-683274176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cd04b1-172d-4ede-89c3-5b6b5e55cdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f682db178b484199c04b8d9294e2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:54Z,use_quota=True,user_id='463c49f2cb9e46f7abd4188d51cdc77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec73a88-a79d-4605-b461-7c712223e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec73a88-a79d-4605-b461-7c712223e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09022fd-ecb1-47f2-9228-7b542e3fc3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09022fd-ecb1-47f2-9228-7b542e3fc3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cd04b1-172d-4ede-89c3-5b6b5e55cdb0', 'volume_name': 'volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18f8328-95f6-4816-af2e-2449b93b7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18f8328-95f6-4816-af2e-2449b93b7951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a22171-bc28-4e1a-b4d0-62c67f100abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0', 'volume_size': 1}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-683274176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cd04b1-172d-4ede-89c3-5b6b5e55cdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f682db178b484199c04b8d9294e2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:34:54Z,use_quota=True,user_id='463c49f2cb9e46f7abd4188d51cdc77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Creating volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:34:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:53 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 1073741824
Sep 25 18:34:53 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:54 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 1073741824" returned: 0 in 0.607s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:54 devstack sudo[97358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0
Sep 25 18:34:54 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:54 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a22171-bc28-4e1a-b4d0-62c67f100abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344529d6-cd32-4724-8183-c9a5a545e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Volume volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 (76cd04b1-172d-4ede-89c3-5b6b5e55cdb0): created successfully
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344529d6-cd32-4724-8183-c9a5a545e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Flow 'volume_create_manager' (a4591c44-2de0-4397-a1d5-b809ba811ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-13a8058c-59c7-471a-8b27-5f96f92f1925 tempest-VolumesSnapshotListTestJSON-286596506 None] Created volume successfully.
Sep 25 18:34:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Creating offline snapshot 17381a6b-9d15-423d-a31e-936fd500f498 of volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:34:56 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c66679-d5a8-4407-a150-8bd6eaca126f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:34:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:56 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0
Sep 25 18:34:56 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:57 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" returned: 0 in 0.650s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:57 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 1G
Sep 25 18:34:57 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:57 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 1G" returned: 0 in 0.733s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:57 devstack sudo[97399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:34:57 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-6b986e2a-b72b-4f1d-9b9e-d451a8f8978d req-af7c7682-98f4-4b28-b1fe-2997ea95f3ae tempest-AttachVolumeTestJSON-556297169 None] Terminate volume connection completed successfully.
Sep 25 18:34:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-6b986e2a-b72b-4f1d-9b9e-d451a8f8978d req-af7c7682-98f4-4b28-b1fe-2997ea95f3ae tempest-AttachVolumeTestJSON-556297169 None] Deleting attachment eac175a5-4ecd-44d4-ba0c-c1d60406b74b. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:34:58 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.459s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:58 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 is being set with open permissions: ugo+rw
Sep 25 18:34:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:58 devstack sudo[97411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:34:58 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-5e214deb-b3c8-4b3a-873f-4afa83a76408 req-3999d75f-bb0f-4dad-aff8-ac85499f122a tempest-TestInstancesWithCinderVolumes-529216369 None] Terminate volume connection completed successfully.
Sep 25 18:34:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-5e214deb-b3c8-4b3a-873f-4afa83a76408 req-3999d75f-bb0f-4dad-aff8-ac85499f122a tempest-TestInstancesWithCinderVolumes-529216369 None] Deleting attachment 137b3144-f7db-49ea-8f7c-f500d6280504. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:34:58 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:58 devstack sudo[97416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info
Sep 25 18:34:58 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:59 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info" returned: 0 in 0.408s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:59 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info is being set with open permissions: ugo+rw
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:59 devstack sudo[97421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info
Sep 25 18:34:59 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:59 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.info" returned: 0 in 0.312s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6b132618-e339-439d-a4b2-3d46f57b6436 tempest-VolumesSnapshotListTestJSON-286596506 None] Create snapshot completed successfully
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "cinder-6f263b50-2dda-40e6-8f7a-22fb21319d8a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-6f263b50-2dda-40e6-8f7a-22fb21319d8a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Flow 'volume_create_manager' (8fc6ce10-57ad-4725-9e84-c47cfc2c0a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5da37c7-4ccd-48af-bcc6-6ae371306c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5da37c7-4ccd-48af-bcc6-6ae371306c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049651961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2ea555-fb06-428d-aba0-f52df3d7cac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9295d37865cb431daff12f0545dd1de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:00Z,use_quota=True,user_id='b24a11c223564c93a9d90191a6591dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088b8358-1658-491a-8991-e3d7ceee4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088b8358-1658-491a-8991-e3d7ceee4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7697aaa-e18b-4c4e-aa20-cb74f135dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7697aaa-e18b-4c4e-aa20-cb74f135dd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2ea555-fb06-428d-aba0-f52df3d7cac1', 'volume_name': 'volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47504f5e-f79f-4182-9e2e-f6f88afde143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47504f5e-f79f-4182-9e2e-f6f88afde143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9755464c-e59d-4113-a4b6-937d5515f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:34:59 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Volume 8c2ea555-fb06-428d-aba0-f52df3d7cac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1', 'volume_size': 1}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049651961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2ea555-fb06-428d-aba0-f52df3d7cac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9295d37865cb431daff12f0545dd1de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:00Z,use_quota=True,user_id='b24a11c223564c93a9d90191a6591dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Creating volume 8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:34:59 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:34:59 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 1073741824
Sep 25 18:34:59 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "cinder-quobyte-6f263b50-2dda-40e6-8f7a-22fb21319d8a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:34:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-quobyte-6f263b50-2dda-40e6-8f7a-22fb21319d8a" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d04454-6d8d-44af-8f36-fb24c0edaaed]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:00 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a
Sep 25 18:35:00 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:00 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 1073741824" returned: 0 in 0.489s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:00 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a" returned: 0 in 0.484s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:00 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:35:00 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:00 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a
Sep 25 18:35:00 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:00 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.393s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.076s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:00 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6f263b50-2dda-40e6-8f7a-22fb21319d8a" returned: 0 in 0.396s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9755464c-e59d-4113-a4b6-937d5515f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedfc008-e697-4338-ad8f-45d8a3058c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Creating offline snapshot 881767a0-e3ca-42ca-b100-b5f6349884f1 of volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-quobyte-6f263b50-2dda-40e6-8f7a-22fb21319d8a" released by "delete_volume" :: held 1.021s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:01 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Volume volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 (8c2ea555-fb06-428d-aba0-f52df3d7cac1): created successfully
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedfc008-e697-4338-ad8f-45d8a3058c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Flow 'volume_create_manager' (8fc6ce10-57ad-4725-9e84-c47cfc2c0a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cf06c9-9328-4cb9-9e5e-f8758d0b0615]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b143a62d-5c4a-43b5-ae62-63eaae0007cd tempest-VolumesActionsTest-1677533887 None] Created volume successfully.
Sep 25 18:35:01 devstack cinder-volume[86534]: WARNING cinder.quota [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915199949-495241653 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915199949-495241653, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:35:01 devstack cinder-volume[86534]: WARNING cinder.quota [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915199949-495241653 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915199949-495241653, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Created reservations ['4c549b25-9e58-4ec9-9c22-7367aa25ae71', '1839ecc6-02c3-4323-806d-964e6b78d6ad', '6f42db51-7f8e-4b6a-af73-33cd4e09d046', 'f0700be0-da49-44f9-9ebc-9c8f0292f1e9'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:01 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:35:01 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:01 devstack sudo[97458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:01 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:01 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.499s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:01 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 1G
Sep 25 18:35:01 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:01 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.310s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Deleted volume successfully.
Sep 25 18:35:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2c0daebe-2478-4d7a-95ad-c0886f55333e tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-6f263b50-2dda-40e6-8f7a-22fb21319d8a-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:02 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 1G" returned: 0 in 0.747s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:02 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:02 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:02 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.391s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:02 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 is being set with open permissions: ugo+rw
Sep 25 18:35:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:02 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:02 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:03 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.367s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-500632b4-5669-400d-b110-492d704b9c50 tempest-VolumesSnapshotListTestJSON-286596506 None] Create snapshot completed successfully
Sep 25 18:35:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Creating offline snapshot 7a681e30-021a-44a3-a3e0-f6232cf9e47b of volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:35:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78bef66-8af8-4a67-8521-dc1b731f0699]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:04 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:04 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-15671eb7-6610-4ff1-a883-2b717cb62044 req-0e387820-533d-488d-ba2a-bec94395cad3 tempest-TestInstancesWithCinderVolumes-529216369 None] Terminate volume connection completed successfully.
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-15671eb7-6610-4ff1-a883-2b717cb62044 req-0e387820-533d-488d-ba2a-bec94395cad3 tempest-TestInstancesWithCinderVolumes-529216369 None] Deleting attachment 951cc895-620e-4723-9ca3-9527530f68a0. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:35:05 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.465s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:05 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b 1G
Sep 25 18:35:05 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "cinder-25a47993-d50f-42f3-bfae-e796f3cc6929-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-25a47993-d50f-42f3-bfae-e796f3cc6929-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "cinder-quobyte-25a47993-d50f-42f3-bfae-e796f3cc6929" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:05 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b 1G" returned: 0 in 0.729s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-quobyte-25a47993-d50f-42f3-bfae-e796f3cc6929" acquired by "delete_volume" :: waited 0.034s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:05 devstack sudo[97632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b
Sep 25 18:35:05 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0d310b-d65b-410b-bd3c-2a613f020dc0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:06 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929
Sep 25 18:35:06 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:06 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b" returned: 0 in 0.647s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:06 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b is being set with open permissions: ugo+rw
Sep 25 18:35:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:06 devstack sudo[97642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b
Sep 25 18:35:06 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:06 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929" returned: 0 in 1.050s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:07 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b" returned: 0 in 0.526s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:07 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929
Sep 25 18:35:07 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.572s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5ba7ea01-8e40-4607-848f-4ccc48a0d2a7 tempest-VolumesSnapshotListTestJSON-286596506 None] Create snapshot completed successfully
Sep 25 18:35:07 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-25a47993-d50f-42f3-bfae-e796f3cc6929" returned: 0 in 0.524s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-quobyte-25a47993-d50f-42f3-bfae-e796f3cc6929" released by "delete_volume" :: held 1.695s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:07 devstack cinder-volume[86534]: WARNING cinder.quota [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-764999257-1081272362 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-764999257-1081272362, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:35:07 devstack cinder-volume[86534]: WARNING cinder.quota [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-764999257-1081272362 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-764999257-1081272362, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Created reservations ['94ec8033-3185-4398-8413-698190151a42', '03171df7-fbdd-4bed-9688-5625ebd3344c', '6526cae5-6c2a-4139-b2b9-00689e87a515', '7f177f3e-14a6-4250-8b52-55fc9a2ee9c4'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:07 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:07 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:08 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.554s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:08 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Deleted volume successfully.
Sep 25 18:35:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f4332e67-eaa6-4b28-9cf8-e7089cc676fc tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-25a47993-d50f-42f3-bfae-e796f3cc6929-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-7a681e30-021a-44a3-a3e0-f6232cf9e47b-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-7a681e30-021a-44a3-a3e0-f6232cf9e47b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-7a681e30-021a-44a3-a3e0-f6232cf9e47b" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-7a681e30-021a-44a3-a3e0-f6232cf9e47b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Deleting offline snapshot 7a681e30-021a-44a3-a3e0-f6232cf9e47b of volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:35:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] snapshot_file for this snap is: volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:35:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf422cb-c802-4245-b4e0-0198d778e6ad]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:10 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b
Sep 25 18:35:10 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:10 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b" returned: 0 in 0.617s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3bc91-092d-403c-a5ef-0d57a190aefd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:10 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:10 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:11 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.494s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:11 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b
Sep 25 18:35:11 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:12 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b" returned: 0 in 0.877s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:12 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b
Sep 25 18:35:12 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:12 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.7a681e30-021a-44a3-a3e0-f6232cf9e47b" returned: 0 in 0.793s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-7a681e30-021a-44a3-a3e0-f6232cf9e47b" released by "_delete_snapshot" :: held 2.971s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" released by "delete_snapshot" :: held 3.025s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:13 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Created reservations ['074dec5f-a32e-49b0-a24b-d9c66a8e6385', '37cfdee9-0aca-413f-a3b5-a145861bc347', '733d86b1-c5bb-43e7-9f89-68f7bfc7c466', '29f1d11c-87ab-45cc-bb79-a2acf8ca617a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:13 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Delete snapshot completed successfully.
Sep 25 18:35:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d9c96788-1d7d-4650-bc26-8f54fbeae5d8 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-7a681e30-021a-44a3-a3e0-f6232cf9e47b-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-881767a0-e3ca-42ca-b100-b5f6349884f1-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-881767a0-e3ca-42ca-b100-b5f6349884f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-881767a0-e3ca-42ca-b100-b5f6349884f1" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-881767a0-e3ca-42ca-b100-b5f6349884f1" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Deleting offline snapshot 881767a0-e3ca-42ca-b100-b5f6349884f1 of volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] snapshot_file for this snap is: volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f92f497-dbbb-4de5-a08c-61145cf8186e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:14 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-fe9dbe16-04e6-48eb-88ee-20a70494c8a6 req-ca6d1bb3-1584-4df0-8511-c94110f632d5 tempest-TestInstancesWithCinderVolumes-529216369 None] Terminate volume connection completed successfully.
Sep 25 18:35:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-fe9dbe16-04e6-48eb-88ee-20a70494c8a6 req-ca6d1bb3-1584-4df0-8511-c94110f632d5 tempest-TestInstancesWithCinderVolumes-529216369 None] Deleting attachment 2935d78e-7c47-43ac-862e-3f20b3940784. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:35:14 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:14 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:15 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.551s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[af10ccb7-e484-4c10-9393-df3b96524098]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:15 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:35:15 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:15 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.655s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:15 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:15 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:16 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.473s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:16 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1
Sep 25 18:35:16 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:16 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.881767a0-e3ca-42ca-b100-b5f6349884f1" returned: 0 in 0.270s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-881767a0-e3ca-42ca-b100-b5f6349884f1" released by "_delete_snapshot" :: held 2.135s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" released by "delete_snapshot" :: held 2.192s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Created reservations ['e4a67cd2-db76-4029-a3cd-ee88af22785b', '9b605e4b-1e43-4d40-bb08-31e3c235d164', 'f267428e-e775-47ab-a250-3c85dbdaba18', '44c53af6-6eaf-4aa6-94a2-fd6b43707b7b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "cinder-9c044867-a226-4f5a-b000-894f68676b28-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-9c044867-a226-4f5a-b000-894f68676b28-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Delete snapshot completed successfully.
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0878e3e0-88da-40ca-9670-c55f88d24222 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-881767a0-e3ca-42ca-b100-b5f6349884f1-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "cinder-quobyte-9c044867-a226-4f5a-b000-894f68676b28" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8894ac14-40fd-4c3e-bcbc-c2eb24cdb328 tempest-VolumesActionsTest-1677533887 None] Acquiring lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1" by "attach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-quobyte-9c044867-a226-4f5a-b000-894f68676b28" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8894ac14-40fd-4c3e-bcbc-c2eb24cdb328 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1" acquired by "attach_volume" :: waited 0.041s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139ae77-202a-4056-bb6f-e075fe7d0aed]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8894ac14-40fd-4c3e-bcbc-c2eb24cdb328 tempest-VolumesActionsTest-1677533887 None] Attaching volume 8c2ea555-fb06-428d-aba0-f52df3d7cac1 to instance 68120498-7441-43c7-b076-86448b74ca30 at mountpoint /dev/vdb on host None.
Sep 25 18:35:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8894ac14-40fd-4c3e-bcbc-c2eb24cdb328 tempest-VolumesActionsTest-1677533887 None] Attach volume completed successfully.
Sep 25 18:35:17 devstack sudo[97827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28
Sep 25 18:35:17 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8894ac14-40fd-4c3e-bcbc-c2eb24cdb328 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1" released by "attach_volume" :: held 0.176s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d6693b8-cbb0-4d39-8332-8513f768b168 tempest-VolumesActionsTest-1677533887 None] Acquiring lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-detach_volume" by "detach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d6693b8-cbb0-4d39-8332-8513f768b168 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2d6693b8-cbb0-4d39-8332-8513f768b168 tempest-VolumesActionsTest-1677533887 None] Detaching volume 8c2ea555-fb06-428d-aba0-f52df3d7cac1 from instance 68120498-7441-43c7-b076-86448b74ca30.
Sep 25 18:35:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2d6693b8-cbb0-4d39-8332-8513f768b168 tempest-VolumesActionsTest-1677533887 None] Detach volume completed successfully.
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d6693b8-cbb0-4d39-8332-8513f768b168 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:17 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28" returned: 0 in 0.488s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:17 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28
Sep 25 18:35:17 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-17381a6b-9d15-423d-a31e-936fd500f498-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-17381a6b-9d15-423d-a31e-936fd500f498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-17381a6b-9d15-423d-a31e-936fd500f498" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-17381a6b-9d15-423d-a31e-936fd500f498" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Deleting offline snapshot 17381a6b-9d15-423d-a31e-936fd500f498 of volume 76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] snapshot_file for this snap is: volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabae5ff-3332-42d2-9c90-0a88f131851e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:18 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9c044867-a226-4f5a-b000-894f68676b28" returned: 0 in 0.492s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-quobyte-9c044867-a226-4f5a-b000-894f68676b28" released by "delete_volume" :: held 1.084s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:18 devstack cinder-volume[86534]: WARNING cinder.quota [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-73012934-1298600996 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-73012934-1298600996, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:35:18 devstack cinder-volume[86534]: WARNING cinder.quota [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-73012934-1298600996 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-73012934-1298600996, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:35:18 devstack sudo[97835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:35:18 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Created reservations ['62675a6c-e272-44f9-a96f-0bb74686ccdf', '1e3b7dec-30e7-464e-befd-689d15db1426', '213f16be-807e-4520-bdbe-97e90cba9966', 'd1f82515-7ce9-40ed-8b25-d61b380f4543'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:18 devstack sudo[97839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:18 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:18 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.663s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c22100-9686-418a-9c46-06c22287f798]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:18 devstack sudo[97850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0
Sep 25 18:35:18 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:18 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.544s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:18 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Deleted volume successfully.
Sep 25 18:35:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-23588ed0-790a-43c9-8702-f0e5b677feeb tempest-TestInstancesWithCinderVolumes-529216369 None] Lock "cinder-9c044867-a226-4f5a-b000-894f68676b28-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:19 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" returned: 0 in 0.660s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:19 devstack sudo[97873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:35:19 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:19 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.432s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:19 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498
Sep 25 18:35:19 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:20 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0.17381a6b-9d15-423d-a31e-936fd500f498" returned: 0 in 0.335s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-17381a6b-9d15-423d-a31e-936fd500f498" released by "_delete_snapshot" :: held 2.301s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" released by "delete_snapshot" :: held 2.340s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:20 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Created reservations ['392e944f-55d6-4584-af07-588c61de148f', 'eda1642f-dd9e-4e99-8eec-04495e170048', '64694c7e-29cc-42a5-8658-6c8e83d4fdf0', '63cff834-545d-4663-b220-828c7e3a6e9a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Delete snapshot completed successfully.
Sep 25 18:35:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f1016dd8-9101-4db3-8208-3ebd9a461fb6 tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-17381a6b-9d15-423d-a31e-936fd500f498-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c45343-15bf-4a70-ba53-1b8b398e4695]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:21 devstack sudo[97884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0
Sep 25 18:35:21 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:21 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" returned: 0 in 0.430s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:21 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0
Sep 25 18:35:21 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:22 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" returned: 0 in 0.317s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-quobyte-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0" released by "delete_volume" :: held 0.858s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Created reservations ['a8c0af25-550f-47bc-8df9-13e87666ecdd', '6cfdfe3f-97b2-4390-81b5-b3b72f58d142', 'ff8f708d-b513-41d6-acba-da5e6b4df554', 'a91cf6a9-d6fa-4f86-a295-08122ebc566d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:22 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:22 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:22 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Deleted volume successfully.
Sep 25 18:35:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-88525330-6921-4a3f-aed9-88e1d50fc9ad tempest-VolumesSnapshotListTestJSON-286596506 None] Lock "cinder-76cd04b1-172d-4ede-89c3-5b6b5e55cdb0-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:32 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=92,cinder:UPDATE=106,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:35:32 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=109,cinder:SELECT=108,cinder:INSERT=33,cinder:DELETE=7 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:35:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0ede8d4d-7e6e-44ae-b750-39c9a2632e37 tempest-VolumesActionsTest-1677533887 None] Acquiring lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1" by "attach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0ede8d4d-7e6e-44ae-b750-39c9a2632e37 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1" acquired by "attach_volume" :: waited 0.048s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0ede8d4d-7e6e-44ae-b750-39c9a2632e37 tempest-VolumesActionsTest-1677533887 None] Attaching volume 8c2ea555-fb06-428d-aba0-f52df3d7cac1 to instance 4ed4d64e-585c-4dc7-98e4-f9159095d173 at mountpoint /dev/vdb on host None.
Sep 25 18:35:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0ede8d4d-7e6e-44ae-b750-39c9a2632e37 tempest-VolumesActionsTest-1677533887 None] Attach volume completed successfully.
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0ede8d4d-7e6e-44ae-b750-39c9a2632e37 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1" released by "attach_volume" :: held 0.241s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (8f6a4629-a485-41b1-9bbf-0e6029187259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f979cdb8-9f57-4350-8b80-c0cb644b8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f979cdb8-9f57-4350-8b80-c0cb644b8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783819538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff64c96a-33e0-4b4f-a502-212c36570ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:40Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21502802-5599-43d4-92df-798c2322e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21502802-5599-43d4-92df-798c2322e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8ddf99-e015-4222-90bc-daa237b9f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8ddf99-e015-4222-90bc-daa237b9f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff64c96a-33e0-4b4f-a502-212c36570ac2', 'volume_name': 'volume-ff64c96a-33e0-4b4f-a502-212c36570ac2', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d8a19f-df8f-4d4f-896d-f86eae998223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d8a19f-df8f-4d4f-896d-f86eae998223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f159786-e475-4bd6-861c-51061c22790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:40 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Volume ff64c96a-33e0-4b4f-a502-212c36570ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff64c96a-33e0-4b4f-a502-212c36570ac2', 'volume_size': 1}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783819538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff64c96a-33e0-4b4f-a502-212c36570ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:40Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Creating volume ff64c96a-33e0-4b4f-a502-212c36570ac2 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:35:40 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4810b908-b15d-4338-89bb-858e3f5c8680 tempest-VolumesActionsTest-1677533887 None] Acquiring lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-detach_volume" by "detach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:40 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 1073741824
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4810b908-b15d-4338-89bb-858e3f5c8680 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4810b908-b15d-4338-89bb-858e3f5c8680 tempest-VolumesActionsTest-1677533887 None] Detaching volume 8c2ea555-fb06-428d-aba0-f52df3d7cac1 from instance 4ed4d64e-585c-4dc7-98e4-f9159095d173.
Sep 25 18:35:40 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4810b908-b15d-4338-89bb-858e3f5c8680 tempest-VolumesActionsTest-1677533887 None] Detach volume completed successfully.
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4810b908-b15d-4338-89bb-858e3f5c8680 tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-detach_volume" released by "detach_volume" :: held 0.210s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (5ad828d8-195b-42c1-840f-007aae5a0d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81098127-0ba3-4937-9a42-49d3a1226557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81098127-0ba3-4937-9a42-49d3a1226557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1904824723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda6bcb1-bf99-4f6d-968d-92e4e3c00c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:41Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4394994b-c6fe-4c25-86e4-5c6dd0766e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4394994b-c6fe-4c25-86e4-5c6dd0766e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5590b5d9-5d19-4b31-b36a-c18b1de73ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5590b5d9-5d19-4b31-b36a-c18b1de73ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda6bcb1-bf99-4f6d-968d-92e4e3c00c57', 'volume_name': 'volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8e7445-5b64-4c78-8343-32c4e26f0e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8e7445-5b64-4c78-8343-32c4e26f0e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d239c4-edba-41a1-aa13-2167dff809cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Volume cda6bcb1-bf99-4f6d-968d-92e4e3c00c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57', 'volume_size': 1}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 1073741824" returned: 0 in 0.981s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:41 devstack sudo[98086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2
Sep 25 18:35:41 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:41 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2" returned: 0 in 0.434s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1904824723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda6bcb1-bf99-4f6d-968d-92e4e3c00c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:41Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Creating volume cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:35:41 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f159786-e475-4bd6-861c-51061c22790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff64c96a-33e0-4b4f-a502-212c36570ac2', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faa7a4f-a253-4ce6-83c2-56b551506944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 1073741824
Sep 25 18:35:41 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Volume volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 (ff64c96a-33e0-4b4f-a502-212c36570ac2): created successfully
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8faa7a4f-a253-4ce6-83c2-56b551506944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (8f6a4629-a485-41b1-9bbf-0e6029187259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-64bfbafa-8878-4e99-a1c1-c821a381c6f2 tempest-CreateVolumesFromImageTest-306280571 None] Created volume successfully.
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (21105758-65d4-4218-a43f-4f3b1ebd9447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f79d3a-7303-47be-87b9-2ed60be7b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f79d3a-7303-47be-87b9-2ed60be7b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2016385606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f992f56f-fefe-4b4f-b0e0-9df896b0839a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:42Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f249a4-7682-4352-8c95-d292247337ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f249a4-7682-4352-8c95-d292247337ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5110fe5c-c8e7-4046-a37a-0b9c62026eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5110fe5c-c8e7-4046-a37a-0b9c62026eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f992f56f-fefe-4b4f-b0e0-9df896b0839a', 'volume_name': 'volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b096cb-d932-4f5d-bf13-3f3df3776d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b096cb-d932-4f5d-bf13-3f3df3776d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d78e95-7174-4617-931e-d95967cb5d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Volume f992f56f-fefe-4b4f-b0e0-9df896b0839a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a', 'volume_size': 1}
Sep 25 18:35:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:42 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 1073741824" returned: 0 in 0.946s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (56c72725-7261-46b3-bd5b-3b409ce30534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ed6d7-b9ab-4e8a-8065-4ca95d29323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ed6d7-b9ab-4e8a-8065-4ca95d29323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-391480124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756aca47-1f42-4976-8f28-42647bd8e5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:42Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db1b27c-f281-49b4-953b-2761cd386980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db1b27c-f281-49b4-953b-2761cd386980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b790623f-eedf-483d-8c66-1acf822e91fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b790623f-eedf-483d-8c66-1acf822e91fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756aca47-1f42-4976-8f28-42647bd8e5e6', 'volume_name': 'volume-756aca47-1f42-4976-8f28-42647bd8e5e6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea86f2-b6ef-4703-a2a3-a567608c9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ea86f2-b6ef-4703-a2a3-a567608c9208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4cc912-279d-44fd-bde6-c49c5af83591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Volume 756aca47-1f42-4976-8f28-42647bd8e5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756aca47-1f42-4976-8f28-42647bd8e5e6', 'volume_size': 1}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:42 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57
Sep 25 18:35:42 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (6068d7b4-796b-4ac2-aad8-34baf68c34ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:43 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e56a2c-d445-4e02-80f9-4175e540159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57" returned: 0 in 0.337s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2016385606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f992f56f-fefe-4b4f-b0e0-9df896b0839a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:42Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Creating volume f992f56f-fefe-4b4f-b0e0-9df896b0839a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:35:43 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d239c4-edba-41a1-aa13-2167dff809cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ec7e9e-ea96-4ff9-a975-235f751c8699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:43 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a 1073741824
Sep 25 18:35:43 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e56a2c-d445-4e02-80f9-4175e540159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601321312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db867187-84d2-474a-a07c-586832c91556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:43Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0054907b-7431-425d-81af-b7dd0534266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0054907b-7431-425d-81af-b7dd0534266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6162713-54d2-4f83-9664-cdac04dd8314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6162713-54d2-4f83-9664-cdac04dd8314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db867187-84d2-474a-a07c-586832c91556', 'volume_name': 'volume-db867187-84d2-474a-a07c-586832c91556', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62f541d-782c-4f53-82d7-ef9bd308fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62f541d-782c-4f53-82d7-ef9bd308fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af71ab61-7728-4c13-951c-8bbf48429ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:43 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Volume db867187-84d2-474a-a07c-586832c91556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db867187-84d2-474a-a07c-586832c91556', 'volume_size': 1}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:43 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Volume volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 (cda6bcb1-bf99-4f6d-968d-92e4e3c00c57): created successfully
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ec7e9e-ea96-4ff9-a975-235f751c8699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (5ad828d8-195b-42c1-840f-007aae5a0d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ce3a42a8-7585-4a1f-8a44-ea810ca05b07 tempest-CreateVolumesFromImageTest-306280571 None] Created volume successfully.
Sep 25 18:35:43 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a 1073741824" returned: 0 in 0.653s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:43 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a
Sep 25 18:35:43 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:44 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a" returned: 0 in 0.321s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-391480124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756aca47-1f42-4976-8f28-42647bd8e5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:42Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Creating volume 756aca47-1f42-4976-8f28-42647bd8e5e6 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:35:44 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:44 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6 1073741824
Sep 25 18:35:44 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d78e95-7174-4617-931e-d95967cb5d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a955fc-23e5-41b6-94ee-61e8c198dcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:44 devstack sudo[98137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:44 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:44 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Volume volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a (f992f56f-fefe-4b4f-b0e0-9df896b0839a): created successfully
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a955fc-23e5-41b6-94ee-61e8c198dcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (21105758-65d4-4218-a43f-4f3b1ebd9447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d0610b73-ca53-4b93-a65f-34755ae1a799 tempest-CreateVolumesFromImageTest-306280571 None] Created volume successfully.
Sep 25 18:35:44 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.385s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:35:44 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6 1073741824" returned: 0 in 0.713s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:44 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6
Sep 25 18:35:44 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:45 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601321312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db867187-84d2-474a-a07c-586832c91556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a2614433554595bbd3bc4b15162aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:35:43Z,use_quota=True,user_id='8c4e74163cfb416d8fde536f58b2d128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Creating volume db867187-84d2-474a-a07c-586832c91556 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:35:45 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4cc912-279d-44fd-bde6-c49c5af83591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756aca47-1f42-4976-8f28-42647bd8e5e6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:45 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556 1073741824
Sep 25 18:35:45 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d89025c-8745-4c6a-a7ff-bfa68b127f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Volume volume-756aca47-1f42-4976-8f28-42647bd8e5e6 (756aca47-1f42-4976-8f28-42647bd8e5e6): created successfully
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d89025c-8745-4c6a-a7ff-bfa68b127f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (56c72725-7261-46b3-bd5b-3b409ce30534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:45 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3a332a3d-08de-4597-a662-c5057a334bc7 tempest-CreateVolumesFromImageTest-306280571 None] Created volume successfully.
Sep 25 18:35:45 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556 1073741824" returned: 0 in 0.506s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:45 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556
Sep 25 18:35:45 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:46 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af71ab61-7728-4c13-951c-8bbf48429ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db867187-84d2-474a-a07c-586832c91556', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac720fe0-3a69-44a2-9445-c21ae327ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:35:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Volume volume-db867187-84d2-474a-a07c-586832c91556 (db867187-84d2-474a-a07c-586832c91556): created successfully
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac720fe0-3a69-44a2-9445-c21ae327ad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Flow 'volume_create_manager' (6068d7b4-796b-4ac2-aad8-34baf68c34ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:35:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-402a8e4b-e249-48e6-a37f-75e353046511 tempest-CreateVolumesFromImageTest-306280571 None] Created volume successfully.
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-db867187-84d2-474a-a07c-586832c91556-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-db867187-84d2-474a-a07c-586832c91556-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-quobyte-db867187-84d2-474a-a07c-586832c91556" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-db867187-84d2-474a-a07c-586832c91556" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f6d5b5-c134-4e4c-a431-df367aca10e5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:46 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556
Sep 25 18:35:46 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:47 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556" returned: 0 in 0.544s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:47 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556
Sep 25 18:35:47 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:47 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-db867187-84d2-474a-a07c-586832c91556" returned: 0 in 0.385s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-db867187-84d2-474a-a07c-586832c91556" released by "delete_volume" :: held 1.021s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Created reservations ['012097d7-2746-49fc-8ebe-ddb1e3d1821c', 'e091b295-6519-4b56-9d25-fc08c038fe24', '7a49f6a9-b6ad-4bb3-ac69-788cf0f66e5a', 'f45b9d30-30ed-4d9d-a2b2-aa07eae82970'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:48 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:48 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:48 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.328s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Deleted volume successfully.
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f0375eee-39ff-45a8-9d4a-ac69e4075c67 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-db867187-84d2-474a-a07c-586832c91556-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd22c0c-4caf-43f0-a8a4-0a1fce8a2bd5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:48 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:35:48 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-756aca47-1f42-4976-8f28-42647bd8e5e6-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-756aca47-1f42-4976-8f28-42647bd8e5e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-quobyte-756aca47-1f42-4976-8f28-42647bd8e5e6" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-756aca47-1f42-4976-8f28-42647bd8e5e6" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f22c1c-c864-4876-aaf0-16d1df0f6855]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:49 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.478s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf37dab-8489-4f4f-8af5-0c8bcdfb2dec]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:49 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6
Sep 25 18:35:49 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:49 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:35:49 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:49 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6" returned: 0 in 0.418s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:49 devstack sudo[98205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6
Sep 25 18:35:49 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:49 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.530s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.4ea25a87-40da-4607-8154-b9d8ad688c9bdl5zej62.img {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:49 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.4ea25a87-40da-4607-8154-b9d8ad688c9bdl5zej62.img
Sep 25 18:35:49 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:49 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-756aca47-1f42-4976-8f28-42647bd8e5e6" returned: 0 in 0.303s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-756aca47-1f42-4976-8f28-42647bd8e5e6" released by "delete_volume" :: held 0.796s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:49 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Created reservations ['97712fc2-ec45-463d-8fae-116de7316371', '0ac2c3ce-a67e-4aca-af84-1d1cad5b8181', 'f5392516-ece3-433a-9138-1719e16db8ef', 'aadcff68-32fa-4c4b-8daf-c2af7959e2d8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:50 devstack sudo[98215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:50 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-f992f56f-fefe-4b4f-b0e0-9df896b0839a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-f992f56f-fefe-4b4f-b0e0-9df896b0839a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-quobyte-f992f56f-fefe-4b4f-b0e0-9df896b0839a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-f992f56f-fefe-4b4f-b0e0-9df896b0839a" acquired by "delete_volume" :: waited 0.047s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae6e57-fb84-4fc8-882c-e2041f9bc931]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:50 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.715s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Deleted volume successfully.
Sep 25 18:35:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce62d7d2-1337-4f43-b24d-6314338b4a64 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-756aca47-1f42-4976-8f28-42647bd8e5e6-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:50 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a
Sep 25 18:35:50 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:51 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a" returned: 0 in 0.980s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:51 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a
Sep 25 18:35:51 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:52 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f992f56f-fefe-4b4f-b0e0-9df896b0839a" returned: 0 in 0.603s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-f992f56f-fefe-4b4f-b0e0-9df896b0839a" released by "delete_volume" :: held 1.684s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Created reservations ['bc744e49-343b-41ce-939d-41d2a25fcfef', '4cb77280-d516-4f1a-8179-f333d8e5b3e2', 'b9c12510-7022-4caa-aaff-15ccf21ea277', 'b735cbec-1816-4c93-b9fb-7f25430b8821'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:52 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:52 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:52 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.501s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:53 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Deleted volume successfully.
Sep 25 18:35:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-dcee6282-55dc-447d-9caf-96ad8e67f8dd tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-f992f56f-fefe-4b4f-b0e0-9df896b0839a-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-quobyte-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57" acquired by "delete_volume" :: waited 0.045s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a78bb5-5324-46c5-84d8-38cc16e305ed]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:53 devstack sudo[98239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57
Sep 25 18:35:53 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:54 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57" returned: 0 in 1.259s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:54 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57
Sep 25 18:35:54 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:55 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57" returned: 0 in 0.743s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57" released by "delete_volume" :: held 2.173s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Created reservations ['8fd0941f-240a-4650-8b12-b5bfec7710ab', '1eb103b6-a33d-4cb5-8347-8b6e6c539b6a', '0e0b2071-eaf0-4533-a5dc-0ca7cbefdc13', '6d2ce254-58a6-4653-bfad-da19e72ed3fa'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:55 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:55 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:56 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.571s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:35:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Deleted volume successfully.
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4961eda8-a57a-4bb6-9c84-f3ac8d6114d4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-cda6bcb1-bf99-4f6d-968d-92e4e3c00c57-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-ff64c96a-33e0-4b4f-a502-212c36570ac2-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-ff64c96a-33e0-4b4f-a502-212c36570ac2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "cinder-quobyte-ff64c96a-33e0-4b4f-a502-212c36570ac2" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:35:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-ff64c96a-33e0-4b4f-a502-212c36570ac2" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:35:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[20499d47-9c3f-49e9-b374-4c7eae89d37e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:35:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:57 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2
Sep 25 18:35:57 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:57 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2" returned: 0 in 0.923s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:58 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2
Sep 25 18:35:58 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:35:58 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Sep 25 18:35:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-ff64c96a-33e0-4b4f-a502-212c36570ac2" returned: 0 in 0.712s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:35:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-quobyte-ff64c96a-33e0-4b4f-a502-212c36570ac2" released by "delete_volume" :: held 1.807s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:35:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Created reservations ['da0bc27d-ae40-482b-ac0b-c2d2d39da82e', 'f91ac40d-0fac-4dd9-96e2-7224f7bd048b', 'c4cb3f42-1c53-4c0c-b6e8-619c8d727890', '8bfd7d99-ce6e-4fbc-be6f-9edbe638fa17'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:35:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:35:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:35:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:35:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:35:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:35:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:35:59 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:35:59 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:00 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 1.326s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:00 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:36:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Deleted volume successfully.
Sep 25 18:36:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5c6fd18a-5320-4976-8e40-7da2e9a87cc4 tempest-CreateVolumesFromImageTest-306280571 None] Lock "cinder-ff64c96a-33e0-4b4f-a502-212c36570ac2-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Flow 'volume_create_manager' (b20279dc-5f60-43eb-98d4-2e670958adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b7a41a-3e51-4b56-b8a2-0180797cda89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b7a41a-3e51-4b56-b8a2-0180797cda89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1077424723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f997d4-d35d-494b-840c-5f1520043780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112afb6fa29a4615ae36dc2c312d9d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:01Z,use_quota=True,user_id='263d43b8b1e54d76ad7868f95ae4db1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9988dbd-3294-478b-a561-dc002e831741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9988dbd-3294-478b-a561-dc002e831741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9260a9-14f2-4091-886b-5aba93a0ecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9260a9-14f2-4091-886b-5aba93a0ecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f997d4-d35d-494b-840c-5f1520043780', 'volume_name': 'volume-54f997d4-d35d-494b-840c-5f1520043780', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595fff44-6c8e-4f45-af21-97c7a5eec8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595fff44-6c8e-4f45-af21-97c7a5eec8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ac48fb-ca50-409b-8322-746096103295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:01 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Volume 54f997d4-d35d-494b-840c-5f1520043780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f997d4-d35d-494b-840c-5f1520043780', 'volume_size': 1}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:01 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.4ea25a87-40da-4607-8154-b9d8ad688c9bdl5zej62.img" returned: 0 in 11.714s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd027b-3630-47bc-bb56-93e2e2ae004f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:01 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:36:01 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:02 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.645s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:02 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1, size 1024.00 MB, duration 11.72 sec, destination /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.4ea25a87-40da-4607-8154-b9d8ad688c9bdl5zej62.img {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:36:02 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Converted 1024.00 MB image at 87.41 MB/s
Sep 25 18:36:02 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] 4ea25a87-40da-4607-8154-b9d8ad688c9b was raw, no need to convert to raw {{(pid=86534) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (927f0bee-fda9-4f78-a8ca-62d1eaa35fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62a4946-7830-4159-8e22-733f65c5fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62a4946-7830-4159-8e22-733f65c5fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340415890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c780ad11-a1dc-4868-9f74-50734619ba44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:05Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d41ec1-21ff-4717-affa-b3f94a9cbc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d41ec1-21ff-4717-affa-b3f94a9cbc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667d04a3-2ffc-44e1-8af7-09208566f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667d04a3-2ffc-44e1-8af7-09208566f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c780ad11-a1dc-4868-9f74-50734619ba44', 'volume_name': 'volume-c780ad11-a1dc-4868-9f74-50734619ba44', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a741906d-3253-49a7-ae26-32eda34c25fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a741906d-3253-49a7-ae26-32eda34c25fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99dca83-2c97-4f97-8099-1f0d7c1b56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:04 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume c780ad11-a1dc-4868-9f74-50734619ba44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c780ad11-a1dc-4868-9f74-50734619ba44', 'volume_size': 1}
Sep 25 18:36:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:INSERT=17,cinder:SELECT=44,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:36:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=46,cinder:UPDATE=57,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.089s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Uploaded volume to glance image-id: 4ea25a87-40da-4607-8154-b9d8ad688c9b. {{(pid=86534) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.400s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1077424723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f997d4-d35d-494b-840c-5f1520043780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112afb6fa29a4615ae36dc2c312d9d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:01Z,use_quota=True,user_id='263d43b8b1e54d76ad7868f95ae4db1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Creating volume 54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:36:22 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:36:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2be07120-303c-4eaf-9e25-5b6b30cd8d16 tempest-VolumesActionsTest-1677533887 None] Copy volume to image completed successfully.
Sep 25 18:36:22 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 1073741824
Sep 25 18:36:22 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:23 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 1073741824" returned: 0 in 0.443s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:23 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780
Sep 25 18:36:23 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Flow 'volume_create_manager' (bf8cdf5b-d999-47f0-a83b-e4a9954b069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c0bcf6-dbb8-453b-8db2-0d338b9a2db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:23 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c0bcf6-dbb8-453b-8db2-0d338b9a2db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627144853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e978aaac-c679-45b0-957b-ccf78107ddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfe4587134d4c9b829de7cfd4eec2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:23Z,use_quota=True,user_id='66f76eedc6de44ce9723c444cc63b29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f7b9cd-190c-4921-84f7-1dba9ff57644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f7b9cd-190c-4921-84f7-1dba9ff57644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d9d3f9-3dd4-4b11-88fc-f027ec60769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d9d3f9-3dd4-4b11-88fc-f027ec60769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e978aaac-c679-45b0-957b-ccf78107ddc3', 'volume_name': 'volume-e978aaac-c679-45b0-957b-ccf78107ddc3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289369c5-0b15-4dd4-a809-0dee69d4606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289369c5-0b15-4dd4-a809-0dee69d4606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd81393-ba84-4063-965b-be8519a52402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:23 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Volume e978aaac-c679-45b0-957b-ccf78107ddc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e978aaac-c679-45b0-957b-ccf78107ddc3', 'volume_size': 1}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780" returned: 0 in 0.306s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.688s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340415890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c780ad11-a1dc-4868-9f74-50734619ba44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:05Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Creating volume c780ad11-a1dc-4868-9f74-50734619ba44 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:36:23 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ac48fb-ca50-409b-8322-746096103295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f997d4-d35d-494b-840c-5f1520043780', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a34602-a1b1-4143-b019-965a6efe9140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:23 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44 1073741824
Sep 25 18:36:23 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:23 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Volume volume-54f997d4-d35d-494b-840c-5f1520043780 (54f997d4-d35d-494b-840c-5f1520043780): created successfully
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a34602-a1b1-4143-b019-965a6efe9140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Flow 'volume_create_manager' (b20279dc-5f60-43eb-98d4-2e670958adb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4e4342e4-7745-4eba-90d6-eccc52053b27 tempest-TestImageHashVerification-503418251 None] Created volume successfully.
Sep 25 18:36:24 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44 1073741824" returned: 0 in 0.476s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:24 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44
Sep 25 18:36:24 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:24 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-627144853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e978aaac-c679-45b0-957b-ccf78107ddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfe4587134d4c9b829de7cfd4eec2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:23Z,use_quota=True,user_id='66f76eedc6de44ce9723c444cc63b29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Creating volume e978aaac-c679-45b0-957b-ccf78107ddc3 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:36:24 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99dca83-2c97-4f97-8099-1f0d7c1b56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c780ad11-a1dc-4868-9f74-50734619ba44', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:24 devstack sudo[98412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3 1073741824
Sep 25 18:36:24 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9cb4bb-8808-4582-9268-4b88adebb979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume volume-c780ad11-a1dc-4868-9f74-50734619ba44 (c780ad11-a1dc-4868-9f74-50734619ba44): created successfully
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9cb4bb-8808-4582-9268-4b88adebb979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (927f0bee-fda9-4f78-a8ca-62d1eaa35fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0b97126b-366b-429b-94a6-17b265d7dc39 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created volume successfully.
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:24 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3 1073741824" returned: 0 in 0.471s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:24 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3
Sep 25 18:36:24 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:25 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.574s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd81393-ba84-4063-965b-be8519a52402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e978aaac-c679-45b0-957b-ccf78107ddc3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba54231-6804-4e47-a9ae-78e6f57a10dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec13b124-edef-4197-bc42-213c5a67af9d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:25 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Volume volume-e978aaac-c679-45b0-957b-ccf78107ddc3 (e978aaac-c679-45b0-957b-ccf78107ddc3): created successfully
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba54231-6804-4e47-a9ae-78e6f57a10dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Flow 'volume_create_manager' (bf8cdf5b-d999-47f0-a83b-e4a9954b069a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9b260220-3984-4373-a4db-b615dc050267 tempest-AttachVolumeTestJSON-556297169 None] Created volume successfully.
Sep 25 18:36:25 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:36:25 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:25 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (a71d40e7-b977-4869-87fd-7665d4bdc448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb5548a-8fc3-4b0a-81db-efb6a4291f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c8e65-939d-45ca-9f09-972763aeeefc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb5548a-8fc3-4b0a-81db-efb6a4291f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316960251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff0e6f2-1630-4789-a560-f9e04fdff638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:26Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a78ef5-6e42-4485-a4c8-010166142638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a78ef5-6e42-4485-a4c8-010166142638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb375acd-e67e-4714-8375-4aaec2d147ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb375acd-e67e-4714-8375-4aaec2d147ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff0e6f2-1630-4789-a560-f9e04fdff638', 'volume_name': 'volume-aff0e6f2-1630-4789-a560-f9e04fdff638', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9ac248-15ed-472c-b183-e25252c43a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9ac248-15ed-472c-b183-e25252c43a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b60cdd-6ccb-4219-b4b8-cf913dcac178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:25 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume aff0e6f2-1630-4789-a560-f9e04fdff638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff0e6f2-1630-4789-a560-f9e04fdff638', 'volume_size': 1}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:25 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:36:25 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (c110a198-2bfe-4016-bce3-889d4ecba653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2bb6c4-67ff-4c0a-a0eb-fe9712465ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2bb6c4-67ff-4c0a-a0eb-fe9712465ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553483679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdebc386-853a-4b96-9070-e9123ff421e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:26Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210136cf-938a-40dc-9958-fcd592eb01ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210136cf-938a-40dc-9958-fcd592eb01ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24cbd35-0166-4ff0-8302-dc66126ed661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24cbd35-0166-4ff0-8302-dc66126ed661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdebc386-853a-4b96-9070-e9123ff421e5', 'volume_name': 'volume-bdebc386-853a-4b96-9070-e9123ff421e5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31bfc56-6049-4031-8ce7-7f466da3fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31bfc56-6049-4031-8ce7-7f466da3fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b058c88-5508-433d-a2c6-50d325251298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume bdebc386-853a-4b96-9070-e9123ff421e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdebc386-853a-4b96-9070-e9123ff421e5', 'volume_size': 1}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:26 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.499s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:26 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img
Sep 25 18:36:26 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (ab866aa1-da36-4316-ae7c-79fcf56f5c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ee5a61-f8ee-4d03-972a-4f1c24e5e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ee5a61-f8ee-4d03-972a-4f1c24e5e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013509679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:27Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0b594d-5db7-4937-935d-104af02fdf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0b594d-5db7-4937-935d-104af02fdf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccc1e95-b674-4739-b87d-40612f5e5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccc1e95-b674-4739-b87d-40612f5e5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8', 'volume_name': 'volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e2a713-7c51-4131-91f7-8efdbc0168a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e2a713-7c51-4131-91f7-8efdbc0168a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bba921-3df8-4b6e-8d38-42d2a6fa24ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8', 'volume_size': 1}
Sep 25 18:36:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c98f8699-d274-4ebb-81f0-65c8e2f7efdb req-9d0595e6-2274-4e43-9f17-6e9fe376b017 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (c2a0d84e-8642-4da6-8055-1ed11e9acac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2f80e4-8a10-4464-ada8-844983de1111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2f80e4-8a10-4464-ada8-844983de1111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1058589728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:27Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c58e600-ef81-4068-890d-dd25e798de65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c58e600-ef81-4068-890d-dd25e798de65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b257d3-858b-440b-b48e-95d241ebc380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b257d3-858b-440b-b48e-95d241ebc380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5', 'volume_name': 'volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2582974d-6686-4e3c-b0ec-bb59e5628aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2582974d-6686-4e3c-b0ec-bb59e5628aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167b5a1a-609a-4eca-8291-60bf8dd634a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:27 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume 27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5', 'volume_size': 1}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (04d26274-a4a3-4fd9-967e-25d27e3bbfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58557e77-f141-4525-ba19-70fe99322c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58557e77-f141-4525-ba19-70fe99322c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809973322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4c67a2-66e2-4c21-aa7b-bec8b26560be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:28Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c44696d-602e-4453-9e2b-487d9c8912b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c44696d-602e-4453-9e2b-487d9c8912b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ac4c8a-e55d-4e07-8eee-3ae310837c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ac4c8a-e55d-4e07-8eee-3ae310837c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4c67a2-66e2-4c21-aa7b-bec8b26560be', 'volume_name': 'volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484b919-9aaf-4994-a80e-eddc7816b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b484b919-9aaf-4994-a80e-eddc7816b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b2c769-4463-488f-a138-f5efe5d8af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:28 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume dd4c67a2-66e2-4c21-aa7b-bec8b26560be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be', 'volume_size': 1}
Sep 25 18:36:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:32 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img" returned: 0 in 6.519s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:32 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[277e9a72-fe54-4005-b9c3-955737f2cc35]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:32 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:36:32 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:33 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.538s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:36:33 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Converted 1024.00 MB image at 157.04 MB/s
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] 759fe9f0-d7c4-41ac-bb0a-ea0720fa4720 was raw, converting to qcow2 {{(pid=86534) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d4fcf2-fdda-4f07-a2ff-16f18028603b]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:33 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img
Sep 25 18:36:33 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:33 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:33 devstack sudo[98503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img
Sep 25 18:36:33 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:33 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img" returned: 1 in 0.314s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:36:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img /opt/stack/data/cinder/conversion/vol_upload_puljaeny {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:33 devstack sudo[98508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img /opt/stack/data/cinder/conversion/vol_upload_puljaeny
Sep 25 18:36:33 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:34 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img /opt/stack/data/cinder/conversion/vol_upload_puljaeny" returned: 0 in 0.272s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:34 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Image conversion details: src /opt/stack/data/cinder/conversion/8c2ea555-fb06-428d-aba0-f52df3d7cac1.temp_image.759fe9f0-d7c4-41ac-bb0a-ea0720fa4720emk4mi45.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_puljaeny {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:36:34 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 25 18:36:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[46709d01-9e1e-4dd5-b2c7-2cfa544533d3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_puljaeny {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:34 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_puljaeny
Sep 25 18:36:34 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:34 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_puljaeny" returned: 0 in 0.324s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.554s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Uploaded volume to glance image-id: 759fe9f0-d7c4-41ac-bb0a-ea0720fa4720. {{(pid=86534) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.935s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316960251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff0e6f2-1630-4789-a560-f9e04fdff638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:26Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Creating volume aff0e6f2-1630-4789-a560-f9e04fdff638 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:36:35 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:36:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:35 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638 1073741824
Sep 25 18:36:35 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-bcee3607-1b44-4a5a-8835-f9674b459582 tempest-VolumesActionsTest-1677533887 None] Copy volume to image completed successfully.
Sep 25 18:36:36 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638 1073741824" returned: 0 in 0.417s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:36 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638
Sep 25 18:36:36 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:36 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638" returned: 0 in 0.247s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 11.101s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b60cdd-6ccb-4219-b4b8-cf913dcac178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff0e6f2-1630-4789-a560-f9e04fdff638', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79abe06c-05d8-4621-82b1-1796af574586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eac797-0da7-47cf-9640-c0c4b585fa62]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume volume-aff0e6f2-1630-4789-a560-f9e04fdff638 (aff0e6f2-1630-4789-a560-f9e04fdff638): created successfully
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79abe06c-05d8-4621-82b1-1796af574586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (a71d40e7-b977-4869-87fd-7665d4bdc448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c1dd6de7-02e0-4ffc-a834-d28f02170f71 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created volume successfully.
Sep 25 18:36:37 devstack sudo[98528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780
Sep 25 18:36:37 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Acquiring lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Acquiring lock "cinder-quobyte-8c2ea555-fb06-428d-aba0-f52df3d7cac1" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Lock "cinder-quobyte-8c2ea555-fb06-428d-aba0-f52df3d7cac1" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[42756df9-c2a8-4ff9-802e-68ec74ad6074]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:37 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66fa440-59d8-4299-99aa-27014c6e825f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:37 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:36:37 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:37 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780
Sep 25 18:36:37 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:37 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.398s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:37 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780" returned: 0 in 0.365s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 /opt/stack/data/cinder/conversion/54f997d4-d35d-494b-840c-5f1520043780.temp_image.a16feceb-43fd-4de2-8131-69295bc16412sb0a047k.img {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:37 devstack sudo[98544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1
Sep 25 18:36:37 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:37 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 /opt/stack/data/cinder/conversion/54f997d4-d35d-494b-840c-5f1520043780.temp_image.a16feceb-43fd-4de2-8131-69295bc16412sb0a047k.img
Sep 25 18:36:37 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:37 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c2ea555-fb06-428d-aba0-f52df3d7cac1" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Lock "cinder-quobyte-8c2ea555-fb06-428d-aba0-f52df3d7cac1" released by "delete_volume" :: held 0.700s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Created reservations ['402fd3fe-f0b4-4cab-97b9-39150a38c592', 'dc3a3012-f24c-445f-a400-026a487d1a75', 'bffa164e-a076-44ae-9247-a83f90239bf7', '97e28b25-a777-456b-a64c-efc4668c8e34'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:38 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:36:38 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:38 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.593s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:36:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Deleted volume successfully.
Sep 25 18:36:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-354a6bd1-6fce-46b1-9d6c-b35eb8f76fea tempest-VolumesActionsTest-1677533887 None] Lock "cinder-8c2ea555-fb06-428d-aba0-f52df3d7cac1-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:44 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:36:44 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:44 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:36:44 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 /opt/stack/data/cinder/conversion/54f997d4-d35d-494b-840c-5f1520043780.temp_image.a16feceb-43fd-4de2-8131-69295bc16412sb0a047k.img" returned: 0 in 7.090s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e08d2f6-e5af-47cd-b31c-627e83b6c831]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:36:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:36:44 devstack sudo[98576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780
Sep 25 18:36:44 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:36:45 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root
Sep 25 18:36:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780" returned: 0 in 0.570s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:36:45 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780, size 1024.00 MB, duration 7.09 sec, destination /opt/stack/data/cinder/conversion/54f997d4-d35d-494b-840c-5f1520043780.temp_image.a16feceb-43fd-4de2-8131-69295bc16412sb0a047k.img {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:36:45 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Converted 1024.00 MB image at 144.40 MB/s
Sep 25 18:36:45 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] a16feceb-43fd-4de2-8131-69295bc16412 was raw, no need to convert to raw {{(pid=86534) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Flow 'volume_create_manager' (256165e3-ef95-495c-aabb-377560bf100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbcd8b2-def6-4ea0-978f-a54a4cfe1469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbcd8b2-def6-4ea0-978f-a54a4cfe1469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-28172305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008c3779-6279-4480-9219-5f2467e84d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454335f86888496c872fe8312b77183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:48Z,use_quota=True,user_id='be5855458c5844b7862514990d99486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfda9d4-b054-4a47-990b-80d9d31a7f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfda9d4-b054-4a47-990b-80d9d31a7f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f125027-bc39-4c5c-87f0-62670d97e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f125027-bc39-4c5c-87f0-62670d97e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008c3779-6279-4480-9219-5f2467e84d2b', 'volume_name': 'volume-008c3779-6279-4480-9219-5f2467e84d2b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ccd806-6689-443f-abf7-3a829696f63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ccd806-6689-443f-abf7-3a829696f63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e052493-17ab-4915-9e89-3c78522f5b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:36:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Volume 008c3779-6279-4480-9219-5f2467e84d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008c3779-6279-4480-9219-5f2467e84d2b', 'volume_size': 1}
Sep 25 18:36:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:36:57 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:36:57 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.609s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Uploaded volume to glance image-id: a16feceb-43fd-4de2-8131-69295bc16412. {{(pid=86534) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 38.346s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553483679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdebc386-853a-4b96-9070-e9123ff421e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:26Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Creating volume bdebc386-853a-4b96-9070-e9123ff421e5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:04 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:04 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5 1073741824
Sep 25 18:37:04 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-57e49260-0c2a-487e-b6b9-b8516a6817e3 tempest-TestImageHashVerification-503418251 None] Copy volume to image completed successfully.
Sep 25 18:37:04 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5 1073741824" returned: 0 in 0.406s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:04 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5
Sep 25 18:37:04 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:05 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 38.491s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013509679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:27Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Creating volume eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:05 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b058c88-5508-433d-a2c6-50d325251298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdebc386-853a-4b96-9070-e9123ff421e5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:05 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 1073741824
Sep 25 18:37:05 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800a552-5a2c-432a-8063-042acc4d4c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:05 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume volume-bdebc386-853a-4b96-9070-e9123ff421e5 (bdebc386-853a-4b96-9070-e9123ff421e5): created successfully
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800a552-5a2c-432a-8063-042acc4d4c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (c110a198-2bfe-4016-bce3-889d4ecba653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4de434ea-4a45-41aa-bfd8-b055167de441 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created volume successfully.
Sep 25 18:37:05 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 1073741824" returned: 0 in 0.418s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:05 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8
Sep 25 18:37:05 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Acquiring lock "cinder-54f997d4-d35d-494b-840c-5f1520043780-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Lock "cinder-54f997d4-d35d-494b-840c-5f1520043780-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Acquiring lock "cinder-quobyte-54f997d4-d35d-494b-840c-5f1520043780" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Lock "cinder-quobyte-54f997d4-d35d-494b-840c-5f1520043780" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[141d0a4c-2c12-4e86-8583-d6d1c3b9cd5c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:05 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c98f8699-d274-4ebb-81f0-65c8e2f7efdb req-9d0595e6-2274-4e43-9f17-6e9fe376b017 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 38.839s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bba921-3df8-4b6e-8d38-42d2a6fa24ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6faba61-2395-4ad1-ac54-63e7da81adf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-c98f8699-d274-4ebb-81f0-65c8e2f7efdb req-9d0595e6-2274-4e43-9f17-6e9fe376b017 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 38.696s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:05 devstack sudo[98601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780
Sep 25 18:37:05 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1058589728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:27Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Creating volume 27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:06 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 (eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8): created successfully
Sep 25 18:37:06 devstack sudo[98604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 1073741824
Sep 25 18:37:06 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6faba61-2395-4ad1-ac54-63e7da81adf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (ab866aa1-da36-4316-ae7c-79fcf56f5c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-668cf845-d8cc-44dd-97a1-cf621cd858d7 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created volume successfully.
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-c98f8699-d274-4ebb-81f0-65c8e2f7efdb req-9d0595e6-2274-4e43-9f17-6e9fe376b017 tempest-AttachVolumeTestJSON-556297169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-e978aaac-c679-45b0-957b-ccf78107ddc3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bd88ddd-f3be-4b70-a241-303d6367ba12', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:37:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-c98f8699-d274-4ebb-81f0-65c8e2f7efdb req-9d0595e6-2274-4e43-9f17-6e9fe376b017 tempest-AttachVolumeTestJSON-556297169 None] attachment_update completed successfully.
Sep 25 18:37:06 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780" returned: 0 in 0.417s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:06 devstack sudo[98612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780
Sep 25 18:37:06 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:06 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 1073741824" returned: 0 in 0.542s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:06 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-54f997d4-d35d-494b-840c-5f1520043780" returned: 0 in 0.324s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:06 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5
Sep 25 18:37:06 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Lock "cinder-quobyte-54f997d4-d35d-494b-840c-5f1520043780" released by "delete_volume" :: held 0.786s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Created reservations ['e7817a4a-1ee9-400b-8d60-cf171717211f', '65f8ad16-dc00-4c23-bc11-f827f3035fb8', '29117f9c-f92d-46f2-b5ee-a55e94152929', '5b58e68d-c740-48a3-b481-f1fc757a73cf'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:06 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:06 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:06 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5" returned: 0 in 0.305s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 38.840s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1809973322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4c67a2-66e2-4c21-aa7b-bec8b26560be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d9e7d1eb88448db3908cf197546b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:28Z,use_quota=True,user_id='c3cc1ee59efc4d85aa6a9ef6fd655565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Creating volume dd4c67a2-66e2-4c21-aa7b-bec8b26560be {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:06 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167b5a1a-609a-4eca-8291-60bf8dd634a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:06 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be 1073741824
Sep 25 18:37:06 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c682d4-57ca-4c2d-ad03-103238f39883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 (27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5): created successfully
Sep 25 18:37:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c682d4-57ca-4c2d-ad03-103238f39883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (c2a0d84e-8642-4da6-8055-1ed11e9acac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0e2b26ae-7be4-4245-9e40-0a9a9eab99e5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created volume successfully.
Sep 25 18:37:07 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Deleted volume successfully.
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce98174-1d32-4859-9f6a-b489a3ca8d16 tempest-TestImageHashVerification-503418251 None] Lock "cinder-54f997d4-d35d-494b-840c-5f1520043780-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:07 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be 1073741824" returned: 0 in 0.676s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:07 devstack sudo[99044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be
Sep 25 18:37:07 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:07 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-28172305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008c3779-6279-4480-9219-5f2467e84d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454335f86888496c872fe8312b77183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:36:48Z,use_quota=True,user_id='be5855458c5844b7862514990d99486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Creating volume 008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:07 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b2c769-4463-488f-a138-f5efe5d8af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:07 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b 1073741824
Sep 25 18:37:07 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78017986-41d9-4aef-912d-303c86532119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Volume volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be (dd4c67a2-66e2-4c21-aa7b-bec8b26560be): created successfully
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78017986-41d9-4aef-912d-303c86532119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Flow 'volume_create_manager' (04d26274-a4a3-4fd9-967e-25d27e3bbfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6678c55a-c147-46fa-b316-5410ddba1f40 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created volume successfully.
Sep 25 18:37:08 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b 1073741824" returned: 0 in 0.520s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:08 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b
Sep 25 18:37:08 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-dd4c67a2-66e2-4c21-aa7b-bec8b26560be-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-dd4c67a2-66e2-4c21-aa7b-bec8b26560be-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-quobyte-dd4c67a2-66e2-4c21-aa7b-bec8b26560be" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-dd4c67a2-66e2-4c21-aa7b-bec8b26560be" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc81a9af-08f7-456a-b777-21151971ac92]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:08 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be
Sep 25 18:37:08 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:08 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e052493-17ab-4915-9e89-3c78522f5b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008c3779-6279-4480-9219-5f2467e84d2b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7ce2ab-4f58-40d7-bf5f-5ad1197569bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Volume volume-008c3779-6279-4480-9219-5f2467e84d2b (008c3779-6279-4480-9219-5f2467e84d2b): created successfully
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7ce2ab-4f58-40d7-bf5f-5ad1197569bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Flow 'volume_create_manager' (256165e3-ef95-495c-aabb-377560bf100a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ee152d83-5558-44ff-832b-ffcee9c708a6 tempest-VolumesCloneTest-1030566500 None] Created volume successfully.
Sep 25 18:37:09 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be" returned: 0 in 0.436s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:09 devstack sudo[99061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be
Sep 25 18:37:09 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Flow 'volume_create_manager' (c108a6b4-9b00-4267-b11b-5d23122e3857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e84117-d994-4038-aa83-24a320f0e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e84117-d994-4038-aa83-24a320f0e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2015741472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cfde63-b5f7-4a7a-9800-916d2d7b1d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfe4587134d4c9b829de7cfd4eec2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:09Z,use_quota=True,user_id='66f76eedc6de44ce9723c444cc63b29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def97e9b-b99c-499f-a236-a8b0774997d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def97e9b-b99c-499f-a236-a8b0774997d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0dfcbf-d396-4e64-9018-6412775dc65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0dfcbf-d396-4e64-9018-6412775dc65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cfde63-b5f7-4a7a-9800-916d2d7b1d68', 'volume_name': 'volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894b9e6d-ad8c-44c5-9438-2261b74e6568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894b9e6d-ad8c-44c5-9438-2261b74e6568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba25500f-4188-490f-be1c-50ac05338db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:09 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Volume 20cfde63-b5f7-4a7a-9800-916d2d7b1d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68', 'volume_size': 1}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2015741472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cfde63-b5f7-4a7a-9800-916d2d7b1d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfe4587134d4c9b829de7cfd4eec2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:09Z,use_quota=True,user_id='66f76eedc6de44ce9723c444cc63b29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Creating volume 20cfde63-b5f7-4a7a-9800-916d2d7b1d68 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:09 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:09 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 1073741824
Sep 25 18:37:09 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:09 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dd4c67a2-66e2-4c21-aa7b-bec8b26560be" returned: 0 in 0.342s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-dd4c67a2-66e2-4c21-aa7b-bec8b26560be" released by "delete_volume" :: held 0.841s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created reservations ['83571822-7c4d-4ca7-8df6-403f6144dbe5', 'f89c0a1f-7478-4255-9c5f-1fc34962bfe5', '57d5b602-6650-49fc-86df-9d456bce1f07', 'f917a25d-f5f9-4657-a036-867fe1fcd96a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:09 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:09 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-quobyte-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5" acquired by "delete_volume" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:09 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c995c118-bbfe-422c-9d0d-ba8ab80242ff]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.381s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Deleted volume successfully.
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e23e1f8c-e600-453a-a081-9d1185fb8ff5 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-dd4c67a2-66e2-4c21-aa7b-bec8b26560be-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:10 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 1073741824" returned: 0 in 0.664s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:10 devstack sudo[99075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5
Sep 25 18:37:10 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:10 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68
Sep 25 18:37:10 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Flow 'volume_create_manager' (10730b1a-2ff9-4b40-b535-732763d3b0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65e6696-260f-4120-b706-c63350af289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65e6696-260f-4120-b706-c63350af289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-368643623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41000830-a059-40bb-860e-fd7153ea5e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='454335f86888496c872fe8312b77183e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=008c3779-6279-4480-9219-5f2467e84d2b,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:10Z,use_quota=True,user_id='be5855458c5844b7862514990d99486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:10 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe39ecf-2089-464c-ac3e-b716b911e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe39ecf-2089-464c-ac3e-b716b911e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c538508d-6973-4d4a-8652-435757664d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68" returned: 0 in 0.387s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:10 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c538508d-6973-4d4a-8652-435757664d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '41000830-a059-40bb-860e-fd7153ea5e88', 'volume_name': 'volume-41000830-a059-40bb-860e-fd7153ea5e88', 'volume_size': 2, 'source_volid': '008c3779-6279-4480-9219-5f2467e84d2b', 'source_volstatus': 'available'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1119019e-19b2-481e-bec1-e13ee32765ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1119019e-19b2-481e-bec1-e13ee32765ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f4f96b-79e3-4f44-b9c0-87a129f5300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:10 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Volume 41000830-a059-40bb-860e-fd7153ea5e88: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-41000830-a059-40bb-860e-fd7153ea5e88', 'volume_size': 2, 'source_volid': '008c3779-6279-4480-9219-5f2467e84d2b', 'source_volstatus': 'available'}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba25500f-4188-490f-be1c-50ac05338db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a6d050-22fa-47c3-8bc5-694312f53da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5" returned: 0 in 0.548s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:10 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Volume volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 (20cfde63-b5f7-4a7a-9800-916d2d7b1d68): created successfully
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a6d050-22fa-47c3-8bc5-694312f53da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:10 devstack sudo[99084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5
Sep 25 18:37:10 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Flow 'volume_create_manager' (c108a6b4-9b00-4267-b11b-5d23122e3857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:10 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Cloning volume 008c3779-6279-4480-9219-5f2467e84d2b to volume 41000830-a059-40bb-860e-fd7153ea5e88
Sep 25 18:37:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ed6d91af-e2ad-4526-9100-56489aa43bca tempest-AttachVolumeTestJSON-556297169 None] Created volume successfully.
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Creating offline snapshot b368b34b-a6b6-496b-8f8d-8051f6ba53fc of volume 008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[215c0cae-c1b0-4b95-a5af-b6309a7666d1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:10 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b
Sep 25 18:37:10 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:10 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5" released by "delete_volume" :: held 0.907s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created reservations ['4caa4d3d-5e11-4773-ad92-5a96b8d06e52', 'dcf30202-f3af-4cda-ba50-192c139140d7', 'a0fffe4a-110a-402b-bb57-f0ec86d8557a', '21c4cbeb-a5a8-4813-97ac-6f2cca4b75b6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:11 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:11 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-quobyte-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:11 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b" returned: 0 in 0.477s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:11 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc 1G
Sep 25 18:37:11 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c3c9b9-78c5-452e-afdc-0b8c7b55e10f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:11 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Deleted volume successfully.
Sep 25 18:37:11 devstack sudo[99100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8
Sep 25 18:37:11 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-be44fee7-1567-4a95-9839-9404e60be48a tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-27d1d15f-e053-4fc3-a6ab-5dd4a3ac4ba5-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:11 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8" returned: 0 in 0.624s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:11 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8
Sep 25 18:37:11 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:11 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc 1G" returned: 0 in 0.804s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008c3779-6279-4480-9219-5f2467e84d2b -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:11 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008c3779-6279-4480-9219-5f2467e84d2b -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc
Sep 25 18:37:11 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:12 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8" returned: 0 in 0.339s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8" released by "delete_volume" :: held 1.046s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created reservations ['a4a5719a-c221-4811-afa3-97c0c3ba9f83', 'e78ef182-626f-4c74-8369-e31625b98618', 'bd80d8e6-54d2-4902-9e73-c7eaea388a7f', '694c5f55-6c03-4ad9-a8e3-695781a91165'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:12 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:12 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:12 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008c3779-6279-4480-9219-5f2467e84d2b -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc" returned: 0 in 0.520s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:12 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc is being set with open permissions: ugo+rw
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:12 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc
Sep 25 18:37:12 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d518b2bb-970b-4152-b70f-2c9107348dec req-8d6c9c17-a8d5-4dc0-8c30-35e32d4b941e tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:12 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.299s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Deleted volume successfully.
Sep 25 18:37:12 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bea83c66-0956-4580-a315-4116a1d86ae4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-eeb6acfc-f5d9-445d-8f86-a7a22aa3b4e8-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc" returned: 0 in 0.286s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:12 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info
Sep 25 18:37:12 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:13 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info" returned: 0 in 0.270s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:13 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info is being set with open permissions: ugo+rw
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:13 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info
Sep 25 18:37:13 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:13 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.info" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "cinder-quobyte-41000830-a059-40bb-860e-fd7153ea5e88" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-41000830-a059-40bb-860e-fd7153ea5e88" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] snapshot: b368b34b-a6b6-496b-8f8d-8051f6ba53fc, volume: 41000830-a059-40bb-860e-fd7153ea5e88,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-bdebc386-853a-4b96-9070-e9123ff421e5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ebf0fe-8eb5-430d-96b7-99ff807b567b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-bdebc386-853a-4b96-9070-e9123ff421e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-quobyte-bdebc386-853a-4b96-9070-e9123ff421e5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-bdebc386-853a-4b96-9070-e9123ff421e5" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d2d5bb-5519-4e41-9673-dbba187cb49e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:13 devstack sudo[99147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc
Sep 25 18:37:13 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:13 devstack sudo[99148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5
Sep 25 18:37:13 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:13 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc" returned: 0 in 0.453s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-008c3779-6279-4480-9219-5f2467e84d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec4e651-e710-407b-ace2-9e893f605ec7]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:13 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5" returned: 0 in 0.427s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:14 devstack sudo[99158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5
Sep 25 18:37:14 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:14 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b
Sep 25 18:37:14 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:14 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bdebc386-853a-4b96-9070-e9123ff421e5" returned: 0 in 0.279s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-bdebc386-853a-4b96-9070-e9123ff421e5" released by "delete_volume" :: held 0.763s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:14 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b" returned: 0 in 0.401s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:14 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88
Sep 25 18:37:14 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created reservations ['da0164b4-6fb1-4a01-a0ea-c6f6ddabd904', 'b9cfee78-5b12-45de-8bf8-e21f22f450f2', 'dfe42f70-8b86-4ebe-a83a-382ca375d90c', '5eb0c20c-871d-46d6-b6e7-3226ae5a259c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:14 devstack sudo[99168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:14 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-aff0e6f2-1630-4789-a560-f9e04fdff638-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-aff0e6f2-1630-4789-a560-f9e04fdff638-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-quobyte-aff0e6f2-1630-4789-a560-f9e04fdff638" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-aff0e6f2-1630-4789-a560-f9e04fdff638" acquired by "delete_volume" :: waited 0.036s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c2abb3-c56a-4966-88f7-9606d34afef9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:14 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.399s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:14 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Deleted volume successfully.
Sep 25 18:37:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0cf62392-4d89-47be-b252-b5a319e818eb tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-bdebc386-853a-4b96-9070-e9123ff421e5-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:14 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638
Sep 25 18:37:14 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:15 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638" returned: 0 in 0.779s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:15 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638
Sep 25 18:37:15 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:16 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aff0e6f2-1630-4789-a560-f9e04fdff638" returned: 0 in 0.628s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-aff0e6f2-1630-4789-a560-f9e04fdff638" released by "delete_volume" :: held 1.476s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created reservations ['8b03247b-1c4b-4187-8cf7-bbd842bdc3b5', '49fa3442-7d11-4628-b125-b43e8116515d', 'e72f7c52-3d2f-4b90-9f51-3091639c7785', 'cb8d9f37-13e3-4f88-8cf5-62d6ec579dd1'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:16 devstack sudo[99189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:16 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:16 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Deleted volume successfully.
Sep 25 18:37:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c0682cce-bbd6-492a-bdd9-ce669e158291 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-aff0e6f2-1630-4789-a560-f9e04fdff638-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-c780ad11-a1dc-4868-9f74-50734619ba44-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-c780ad11-a1dc-4868-9f74-50734619ba44-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "cinder-quobyte-c780ad11-a1dc-4868-9f74-50734619ba44" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-c780ad11-a1dc-4868-9f74-50734619ba44" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee2ab57-a26f-4bea-bde9-af5b81cd2348]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:17 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44
Sep 25 18:37:17 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:18 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44" returned: 0 in 0.802s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:18 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44
Sep 25 18:37:18 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:18 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c780ad11-a1dc-4868-9f74-50734619ba44" returned: 0 in 0.533s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-quobyte-c780ad11-a1dc-4868-9f74-50734619ba44" released by "delete_volume" :: held 1.490s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Created reservations ['694ab96c-7fe9-4a3a-b0cf-366b5a2793cf', 'c6359aeb-70a4-427a-aa68-7f53f1aa41c4', '8ad69663-09e4-46a3-8e7e-91fd80b89258', '481722e2-ad2c-4122-a2fc-2d05b5762e8d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:19 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:19 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:19 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.572s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:19 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Deleted volume successfully.
Sep 25 18:37:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-732c8e42-d8d0-448a-9cab-661881ce8cb4 tempest-CreateVolumesFromSourceVolumeTest-412469587 None] Lock "cinder-c780ad11-a1dc-4868-9f74-50734619ba44-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:22 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88" returned: 0 in 8.626s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:22 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:37:22 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Converted 1024.00 MB image at 118.69 MB/s
Sep 25 18:37:22 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 is being set with open permissions: ugo+rw
Sep 25 18:37:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:22 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88
Sep 25 18:37:22 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:23 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-41000830-a059-40bb-860e-fd7153ea5e88" released by "_copy_volume_from_snapshot" :: held 9.819s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "cinder-quobyte-b368b34b-a6b6-496b-8f8d-8051f6ba53fc" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-b368b34b-a6b6-496b-8f8d-8051f6ba53fc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Deleting offline snapshot b368b34b-a6b6-496b-8f8d-8051f6ba53fc of volume 008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] snapshot_file for this snap is: volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec26b9fc-36b3-46f6-9d3e-04a3c57943d3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:23 devstack sudo[99220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc
Sep 25 18:37:23 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:23 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc" returned: 0 in 0.427s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-008c3779-6279-4480-9219-5f2467e84d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70222866-d8d0-4c85-80a2-4786feaad58c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:23 devstack sudo[99225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b
Sep 25 18:37:23 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:24 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b" returned: 0 in 0.595s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:24 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc
Sep 25 18:37:24 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:24 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Flow 'volume_create_manager' (92faa10d-d566-431f-b801-772c811d3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4160688d-327c-48b0-9f16-1fe364932349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc" returned: 0 in 0.448s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4160688d-327c-48b0-9f16-1fe364932349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3054e7-ab5e-468e-ab75-b7591fb94467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089434bd533340d08cfef3d57cf4a9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:25Z,use_quota=True,user_id='fbc28e3519634a25bccef914b3e87593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535e6451-d828-425c-b062-1c58324255e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:24 devstack sudo[99237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc
Sep 25 18:37:24 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535e6451-d828-425c-b062-1c58324255e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3917f486-6bae-4bba-9473-447cfeddb22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3917f486-6bae-4bba-9473-447cfeddb22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3054e7-ab5e-468e-ab75-b7591fb94467', 'volume_name': 'volume-bb3054e7-ab5e-468e-ab75-b7591fb94467', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8133b5-1840-4743-9f59-9444c74fb093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8133b5-1840-4743-9f59-9444c74fb093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323835a4-368f-40dd-be01-5198fe38d733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Volume bb3054e7-ab5e-468e-ab75-b7591fb94467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3054e7-ab5e-468e-ab75-b7591fb94467', 'volume_size': 1}
Sep 25 18:37:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:25 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b.b368b34b-a6b6-496b-8f8d-8051f6ba53fc" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-b368b34b-a6b6-496b-8f8d-8051f6ba53fc" released by "_delete_snapshot" :: held 1.892s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.558s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d518b2bb-970b-4152-b70f-2c9107348dec req-8d6c9c17-a8d5-4dc0-8c30-35e32d4b941e tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.615s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-d518b2bb-970b-4152-b70f-2c9107348dec req-8d6c9c17-a8d5-4dc0-8c30-35e32d4b941e tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3054e7-ab5e-468e-ab75-b7591fb94467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089434bd533340d08cfef3d57cf4a9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:25Z,use_quota=True,user_id='fbc28e3519634a25bccef914b3e87593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Creating volume bb3054e7-ab5e-468e-ab75-b7591fb94467 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:25 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f4f96b-79e3-4f44-b9c0-87a129f5300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41000830-a059-40bb-860e-fd7153ea5e88', 'volume_size': 2, 'source_volid': '008c3779-6279-4480-9219-5f2467e84d2b', 'source_volstatus': 'available'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:25 devstack sudo[99240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 1073741824
Sep 25 18:37:25 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f158218-55d2-4a89-9a22-9b204666199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:25 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Volume volume-41000830-a059-40bb-860e-fd7153ea5e88 (41000830-a059-40bb-860e-fd7153ea5e88): created successfully
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f158218-55d2-4a89-9a22-9b204666199f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Flow 'volume_create_manager' (10730b1a-2ff9-4b40-b535-732763d3b0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d518b2bb-970b-4152-b70f-2c9107348dec req-8d6c9c17-a8d5-4dc0-8c30-35e32d4b941e tempest-AttachVolumeTestJSON-556297169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f61b217b-f7d8-4dc0-8331-4ee80a3ee690', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:37:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a41e9144-9655-428f-8987-4750877759a6 tempest-VolumesCloneTest-1030566500 None] Created volume successfully.
Sep 25 18:37:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-d518b2bb-970b-4152-b70f-2c9107348dec req-8d6c9c17-a8d5-4dc0-8c30-35e32d4b941e tempest-AttachVolumeTestJSON-556297169 None] attachment_update completed successfully.
Sep 25 18:37:25 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 1073741824" returned: 0 in 0.525s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:25 devstack sudo[99252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467
Sep 25 18:37:25 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:26 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467" returned: 0 in 0.342s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323835a4-368f-40dd-be01-5198fe38d733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3054e7-ab5e-468e-ab75-b7591fb94467', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe88c5a-53f0-4208-b916-ac06f88d0b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Volume volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 (bb3054e7-ab5e-468e-ab75-b7591fb94467): created successfully
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe88c5a-53f0-4208-b916-ac06f88d0b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Flow 'volume_create_manager' (92faa10d-d566-431f-b801-772c811d3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a7348201-cbe0-448f-8b33-9873ea6c658c tempest-CinderUnicodeTest-611809852 None] Created volume successfully.
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Acquiring lock "cinder-41000830-a059-40bb-860e-fd7153ea5e88-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Lock "cinder-41000830-a059-40bb-860e-fd7153ea5e88-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Acquiring lock "cinder-quobyte-41000830-a059-40bb-860e-fd7153ea5e88" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-41000830-a059-40bb-860e-fd7153ea5e88" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdab8c-f0c6-47cc-ac5b-bdfd5fb3446c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:26 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88
Sep 25 18:37:26 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:26 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88" returned: 0 in 0.438s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:26 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88
Sep 25 18:37:26 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:27 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-41000830-a059-40bb-860e-fd7153ea5e88" returned: 0 in 0.324s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-41000830-a059-40bb-860e-fd7153ea5e88" released by "delete_volume" :: held 0.816s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Created reservations ['ed02d039-b648-40c3-a46b-af5122f06a04', 'f2bf8801-fb32-433d-857c-927c7b3e5e85', '48d3df4a-0830-4ccb-9391-ec4aa8bffd6c', '5edb05f6-1520-4ef9-9f21-34f7259274c0'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:27 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:27 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Flow 'volume_create_manager' (052a2d37-e855-4d84-b4a7-5658f77dffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07faa7d6-79fe-4e2e-8e54-b8c2471d2ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07faa7d6-79fe-4e2e-8e54-b8c2471d2ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-4427018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64aa974-d903-4111-ab54-d81496248f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089434bd533340d08cfef3d57cf4a9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:27Z,use_quota=True,user_id='fbc28e3519634a25bccef914b3e87593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c02f6f-7a01-4061-9c14-e668fb1d7170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c02f6f-7a01-4061-9c14-e668fb1d7170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08373185-81d2-4b43-99dd-e6aa7133e269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08373185-81d2-4b43-99dd-e6aa7133e269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64aa974-d903-4111-ab54-d81496248f34', 'volume_name': 'volume-c64aa974-d903-4111-ab54-d81496248f34', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3083ff79-96d6-47e0-a237-fc2082324759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3083ff79-96d6-47e0-a237-fc2082324759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c29811-dbcc-4e63-bf69-1a06c1060136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:27 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Volume c64aa974-d903-4111-ab54-d81496248f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64aa974-d903-4111-ab54-d81496248f34', 'volume_size': 1}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-4427018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64aa974-d903-4111-ab54-d81496248f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089434bd533340d08cfef3d57cf4a9bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:27Z,use_quota=True,user_id='fbc28e3519634a25bccef914b3e87593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Creating volume c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:27 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "cinder-008c3779-6279-4480-9219-5f2467e84d2b-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:27 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 1073741824
Sep 25 18:37:27 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-008c3779-6279-4480-9219-5f2467e84d2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "cinder-quobyte-008c3779-6279-4480-9219-5f2467e84d2b" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-008c3779-6279-4480-9219-5f2467e84d2b" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:27 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.403s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Deleted volume successfully.
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b756867-6d0b-4769-a127-fb5517991419]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d586f032-0b8e-4a55-9028-e0c6023ab39b tempest-VolumesCloneTest-1030566500 None] Lock "cinder-41000830-a059-40bb-860e-fd7153ea5e88-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:28 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b
Sep 25 18:37:28 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-5e146e6d-dec8-4065-8f09-5c82f24483d8 req-3868c727-7788-4ab9-a2b9-d1e7f6b94e79 tempest-AttachVolumeTestJSON-556297169 None] Terminate volume connection completed successfully.
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-5e146e6d-dec8-4065-8f09-5c82f24483d8 req-3868c727-7788-4ab9-a2b9-d1e7f6b94e79 tempest-AttachVolumeTestJSON-556297169 None] Deleting attachment 3bd88ddd-f3be-4b70-a241-303d6367ba12. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:37:28 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 1073741824" returned: 0 in 0.587s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:28 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34
Sep 25 18:37:28 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:28 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b" returned: 0 in 0.602s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:28 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b
Sep 25 18:37:28 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:28 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34" returned: 0 in 0.387s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c29811-dbcc-4e63-bf69-1a06c1060136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64aa974-d903-4111-ab54-d81496248f34', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32c533-1d06-41d1-a82f-b367fd4fec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:28 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Volume volume-c64aa974-d903-4111-ab54-d81496248f34 (c64aa974-d903-4111-ab54-d81496248f34): created successfully
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32c533-1d06-41d1-a82f-b367fd4fec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Flow 'volume_create_manager' (052a2d37-e855-4d84-b4a7-5658f77dffac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-368b851e-2e43-4053-8d44-2fb768848d61 tempest-CinderUnicodeTest-611809852 None] Created volume successfully.
Sep 25 18:37:28 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-008c3779-6279-4480-9219-5f2467e84d2b" returned: 0 in 0.387s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-quobyte-008c3779-6279-4480-9219-5f2467e84d2b" released by "delete_volume" :: held 1.077s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Created reservations ['183e17e5-dd48-4061-8126-0add93d783e0', '3c432160-7226-4e4a-b7ed-1ae2a80627c7', '92b5c565-c7b3-4ba9-a6fe-102e218992d9', '61793ad2-a4b8-4976-8d44-03d5ead93b90'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:29 devstack sudo[99350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:29 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Flow 'volume_create_manager' (3a281bc6-8d0a-46a7-b600-eaba06335f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29929c7f-4dd8-4271-a46a-49bb372f00ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29929c7f-4dd8-4271-a46a-49bb372f00ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0921cfd-d927-4787-b3d0-44eaf376e7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ee4e3707ba4bfdbcfcc2bceee348ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:29Z,use_quota=True,user_id='51d63e686836452090f3a22cf9118118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bbf5473-2ff2-4024-9d76-0690cda54dbe),volume_type_id=0bbf5473-2ff2-4024-9d76-0690cda54dbe)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fae75d4-38ff-4cdc-a22e-c245ffb2dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fae75d4-38ff-4cdc-a22e-c245ffb2dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec636c8-3f49-4cf2-8917-adf4e0528189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:37:29 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.333s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Deleted volume successfully.
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-55a33e09-28ed-4223-8c09-839be1cb46b1 tempest-VolumesCloneTest-1030566500 None] Lock "cinder-008c3779-6279-4480-9219-5f2467e84d2b-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec636c8-3f49-4cf2-8917-adf4e0528189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0921cfd-d927-4787-b3d0-44eaf376e7e7', 'volume_name': 'volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7', 'volume_size': 1, 'image_id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7dbaa428-e130-44fd-8052-82c5c8633918', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5999ee70d533c0d2649e7236dc7526fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08ee4e3707ba4bfdbcfcc2bceee348ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6424650cc09a905157b94e8ad70b5767f5c217975025212d3d0387183865fc51ddd76b1e46102a8ce28705b88070f7342f0aec5a67c3cfc9553e139ee696aa1d', 'id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'created_at': datetime.datetime(2026, 9, 25, 16, 37, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 37, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7dbaa428-e130-44fd-8052-82c5c8633918/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7fbd0d0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa76df1-b114-4d00-8673-dc5f74ab61bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa76df1-b114-4d00-8673-dc5f74ab61bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ed4c84-ddcd-4c81-bc29-45984e7463b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Volume b0921cfd-d927-4787-b3d0-44eaf376e7e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7', 'volume_size': 1, 'image_id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7dbaa428-e130-44fd-8052-82c5c8633918', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5999ee70d533c0d2649e7236dc7526fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08ee4e3707ba4bfdbcfcc2bceee348ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6424650cc09a905157b94e8ad70b5767f5c217975025212d3d0387183865fc51ddd76b1e46102a8ce28705b88070f7342f0aec5a67c3cfc9553e139ee696aa1d', 'id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'created_at': datetime.datetime(2026, 9, 25, 16, 37, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 37, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7dbaa428-e130-44fd-8052-82c5c8633918/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7fbd0d0>}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Trying to clone b0921cfd-d927-4787-b3d0-44eaf376e7e7 from image 7dbaa428-e130-44fd-8052-82c5c8633918 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7dbaa428-e130-44fd-8052-82c5c8633918', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:37:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-952a550d-f79d-4c44-a5d6-938af8a2a815 req-ef3d8bce-2891-461f-98d5-51970cb943f8 tempest-AttachVolumeTestJSON-556297169 None] Terminate volume connection completed successfully.
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-952a550d-f79d-4c44-a5d6-938af8a2a815 req-ef3d8bce-2891-461f-98d5-51970cb943f8 tempest-AttachVolumeTestJSON-556297169 None] Deleting attachment f61b217b-f7d8-4dc0-8331-4ee80a3ee690. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:37:29 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Creating offline snapshot b90e845c-af81-4da9-b7e9-8d88a78ba4dc of volume c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d231f2d-ac17-45b2-83ab-d2d9181ef526]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093324d-881d-4db6-93fa-953c3ada043f]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:30 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34
Sep 25 18:37:30 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:30 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD
Sep 25 18:37:30 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:30 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:30 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34" returned: 0 in 0.539s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:30 devstack sudo[99370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc 1G
Sep 25 18:37:30 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:30 devstack sudo[99369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD
Sep 25 18:37:30 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:30 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Temporary image 7dbaa428-e130-44fd-8052-82c5c8633918 is fetched for user 51d63e686836452090f3a22cf9118118. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdcf21b-fa73-4c34-93df-000b35ccefe4]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:31 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc 1G" returned: 0 in 0.556s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64aa974-d903-4111-ab54-d81496248f34 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:31 devstack sudo[99381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64aa974-d903-4111-ab54-d81496248f34 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc
Sep 25 18:37:31 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:31 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD
Sep 25 18:37:31 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:31 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:31 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64aa974-d903-4111-ab54-d81496248f34 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc" returned: 0 in 0.505s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:31 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc is being set with open permissions: ugo+rw
Sep 25 18:37:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:31 devstack sudo[99399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc
Sep 25 18:37:31 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:31 devstack sudo[99394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD
Sep 25 18:37:31 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:32 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc" returned: 0 in 0.465s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:32 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD" returned: 1 in 0.566s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:32 devstack sudo[99421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info
Sep 25 18:37:32 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:32 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info" returned: 0 in 0.405s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info is being set with open permissions: ugo+rw
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:32 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info
Sep 25 18:37:32 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:32 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.info" returned: 0 in 0.328s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0921cfd-d927-4787-b3d0-44eaf376e7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ee4e3707ba4bfdbcfcc2bceee348ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:29Z,use_quota=True,user_id='51d63e686836452090f3a22cf9118118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bbf5473-2ff2-4024-9d76-0690cda54dbe),volume_type_id=0bbf5473-2ff2-4024-9d76-0690cda54dbe)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Creating volume b0921cfd-d927-4787-b3d0-44eaf376e7e7 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:32 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:32 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 1073741824
Sep 25 18:37:32 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f8da26cb-aadc-42f4-996b-678f08b63927 tempest-CinderUnicodeTest-611809852 None] Create snapshot completed successfully
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-b90e845c-af81-4da9-b7e9-8d88a78ba4dc-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Lock "cinder-b90e845c-af81-4da9-b7e9-8d88a78ba4dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-quobyte-c64aa974-d903-4111-ab54-d81496248f34" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-c64aa974-d903-4111-ab54-d81496248f34" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-quobyte-b90e845c-af81-4da9-b7e9-8d88a78ba4dc" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-b90e845c-af81-4da9-b7e9-8d88a78ba4dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Deleting offline snapshot b90e845c-af81-4da9-b7e9-8d88a78ba4dc of volume c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] snapshot_file for this snap is: volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf6851f-3355-43a5-af01-d306fc8e0b1d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:33 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc
Sep 25 18:37:33 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:33 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 1073741824" returned: 0 in 0.677s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:33 devstack sudo[99439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7
Sep 25 18:37:33 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:33 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc" returned: 0 in 0.540s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c64aa974-d903-4111-ab54-d81496248f34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2859323-80ee-4715-bb0d-475119b0614e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:33 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7" returned: 0 in 0.346s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:33 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34
Sep 25 18:37:33 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Attempting download of 7dbaa428-e130-44fd-8052-82c5c8633918 ((None, [{'url': 'file:///opt/stack/data/glance/images/7dbaa428-e130-44fd-8052-82c5c8633918', 'metadata': {}}])) to volume b0921cfd-d927-4787-b3d0-44eaf376e7e7. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcb950c-8537-4a04-89aa-05bdc24f1efb]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:34 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n
Sep 25 18:37:34 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:34 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34" returned: 0 in 0.498s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:34 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc
Sep 25 18:37:34 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:34 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n" returned: 0 in 0.479s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:34 devstack sudo[99456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n
Sep 25 18:37:34 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:34 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc" returned: 0 in 0.546s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:34 devstack sudo[99462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc
Sep 25 18:37:34 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:34 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n" returned: 1 in 0.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7dbaa428-e130-44fd-8052-82c5c8633918_2wp9b12n' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[148daed8-d813-4c14-8f80-7176d70624bc]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:35 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD
Sep 25 18:37:35 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:35 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "cinder-20cfde63-b5f7-4a7a-9800-916d2d7b1d68-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34.b90e845c-af81-4da9-b7e9-8d88a78ba4dc" returned: 0 in 0.361s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-20cfde63-b5f7-4a7a-9800-916d2d7b1d68-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-b90e845c-af81-4da9-b7e9-8d88a78ba4dc" released by "_delete_snapshot" :: held 2.180s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-c64aa974-d903-4111-ab54-d81496248f34" released by "delete_snapshot" :: held 2.216s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:35 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "cinder-quobyte-20cfde63-b5f7-4a7a-9800-916d2d7b1d68" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-quobyte-20cfde63-b5f7-4a7a-9800-916d2d7b1d68" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ad9119-3fa8-4643-bab7-04349ffd1ca1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:35 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD
Sep 25 18:37:35 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Created reservations ['4e92e75a-cf85-4f04-8c83-6bcb0abbcaae', '53b09d63-cd40-4b67-99b2-a6dec94adcfb', '58d295bc-6d64-403c-97e8-28bba5d3bd14', '473118b5-2a9a-4f8a-88e2-97262ba75d8a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Delete snapshot completed successfully.
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9377d09c-0572-41f2-b22c-f7f959ed244c tempest-CinderUnicodeTest-611809852 None] Lock "cinder-b90e845c-af81-4da9-b7e9-8d88a78ba4dc-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:35 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68
Sep 25 18:37:35 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:35 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] 7dbaa428-e130-44fd-8052-82c5c8633918 was raw, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:35 devstack sudo[99478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7
Sep 25 18:37:35 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Flow 'volume_create_manager' (6355bfb1-3682-4a36-a3ce-a6b3109b2bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaa7d09-5df3-4285-922b-feffdc85eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaa7d09-5df3-4285-922b-feffdc85eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1669300000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36802462-875a-4729-ac8c-039c135749e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e34b80e38044d185578dc76288522a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:36Z,use_quota=True,user_id='21b1b28f73f0402392eaa05f60407f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d69a265-030d-487e-8f52-d66d28eed6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d69a265-030d-487e-8f52-d66d28eed6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e794dba8-1a0a-483f-bc7c-dbd82bfa2d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:37:35 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68" returned: 0 in 0.455s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:35 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68
Sep 25 18:37:35 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e794dba8-1a0a-483f-bc7c-dbd82bfa2d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36802462-875a-4729-ac8c-039c135749e5', 'volume_name': 'volume-36802462-875a-4729-ac8c-039c135749e5', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb84465a0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5893a5e-9fbc-4869-ad71-3af550377c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5893a5e-9fbc-4869-ad71-3af550377c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84347411-875d-4d75-8381-333fb2c93666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Volume 36802462-875a-4729-ac8c-039c135749e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36802462-875a-4729-ac8c-039c135749e5', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb84465a0>}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Trying to clone 36802462-875a-4729-ac8c-039c135749e5 from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:37:36 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-20cfde63-b5f7-4a7a-9800-916d2d7b1d68" returned: 0 in 0.272s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-quobyte-20cfde63-b5f7-4a7a-9800-916d2d7b1d68" released by "delete_volume" :: held 0.775s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Created reservations ['71a2ca6d-b5ae-4b49-8992-300872ae2aa3', '3a2d75a1-cdbe-4924-aab8-6ff879b4748b', '1050b242-4194-47c7-b5ad-33886390c0e9', '4f7779b0-0aae-44ce-beb2-b913586731ee'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:36 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7" returned: 0 in 0.617s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7dbaa428-e130-44fd-8052-82c5c8633918_luck25k0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:37:36 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-c64aa974-d903-4111-ab54-d81496248f34-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:36 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 1G
Sep 25 18:37:36 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-c64aa974-d903-4111-ab54-d81496248f34-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-quobyte-c64aa974-d903-4111-ab54-d81496248f34" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-c64aa974-d903-4111-ab54-d81496248f34" acquired by "delete_volume" :: waited 0.042s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:36 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:36 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b0256-3515-47ff-be27-a4a3e1cab3f5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:37:36 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb248ebf-0e57-40ba-a031-77a9b75cc2be]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:36 devstack sudo[99495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34
Sep 25 18:37:36 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:36 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 1G" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Downloaded image 7dbaa428-e130-44fd-8052-82c5c8633918 ((None, [{'url': 'file:///opt/stack/data/glance/images/7dbaa428-e130-44fd-8052-82c5c8633918', 'metadata': {}}])) to volume b0921cfd-d927-4787-b3d0-44eaf376e7e7 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Temporary image 7dbaa428-e130-44fd-8052-82c5c8633918 for user 51d63e686836452090f3a22cf9118118 is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Marking volume b0921cfd-d927-4787-b3d0-44eaf376e7e7 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Copying metadata from image 7dbaa428-e130-44fd-8052-82c5c8633918 to b0921cfd-d927-4787-b3d0-44eaf376e7e7. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Creating volume glance metadata for volume b0921cfd-d927-4787-b3d0-44eaf376e7e7 backed by image 7dbaa428-e130-44fd-8052-82c5c8633918 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5999ee70d533c0d2649e7236dc7526fa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:37:36 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.301s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Deleted volume successfully.
Sep 25 18:37:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-43a20820-1c81-4c0d-8236-80a065c16b85 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-20cfde63-b5f7-4a7a-9800-916d2d7b1d68-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:36 devstack sudo[99500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD
Sep 25 18:37:36 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ed4c84-ddcd-4c81-bc29-45984e7463b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7', 'volume_size': 1, 'image_id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7dbaa428-e130-44fd-8052-82c5c8633918', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5999ee70d533c0d2649e7236dc7526fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '08ee4e3707ba4bfdbcfcc2bceee348ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6424650cc09a905157b94e8ad70b5767f5c217975025212d3d0387183865fc51ddd76b1e46102a8ce28705b88070f7342f0aec5a67c3cfc9553e139ee696aa1d', 'id': '7dbaa428-e130-44fd-8052-82c5c8633918', 'created_at': datetime.datetime(2026, 9, 25, 16, 37, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 37, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7dbaa428-e130-44fd-8052-82c5c8633918/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7fbd0d0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40edccf-6290-438d-b4ce-d43804939a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:37 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Volume volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 (b0921cfd-d927-4787-b3d0-44eaf376e7e7): created successfully
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40edccf-6290-438d-b4ce-d43804939a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Flow 'volume_create_manager' (3a281bc6-8d0a-46a7-b600-eaba06335f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7e75937f-4e9c-4e51-935c-278d575b121d tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Created volume successfully.
Sep 25 18:37:37 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34" returned: 0 in 0.456s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:37 devstack sudo[99507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34
Sep 25 18:37:37 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:37 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 is fetched for user 21b1b28f73f0402392eaa05f60407f8d. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba02c4c-43ab-4a09-9d7c-a52727c2dddd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:37 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:37 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD
Sep 25 18:37:37 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c64aa974-d903-4111-ab54-d81496248f34" returned: 0 in 0.259s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-c64aa974-d903-4111-ab54-d81496248f34" released by "delete_volume" :: held 0.787s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Created reservations ['706e5310-9b60-4b55-840c-e09ca2d4e03f', '6f4c44ff-831e-4f5f-89a0-f6ccca107cfe', 'c7eef162-339e-4eb7-bc7b-2ff40ae46431', '4b3ff153-ad2b-4308-9eb3-c774917963ac'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:37 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:37 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "cinder-e978aaac-c679-45b0-957b-ccf78107ddc3-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:37 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1669300000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36802462-875a-4729-ac8c-039c135749e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e34b80e38044d185578dc76288522a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:36Z,use_quota=True,user_id='21b1b28f73f0402392eaa05f60407f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Creating volume 36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:37 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-e978aaac-c679-45b0-957b-ccf78107ddc3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-bb3054e7-ab5e-468e-ab75-b7591fb94467-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:37 devstack sudo[99520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 1073741824
Sep 25 18:37:37 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-bb3054e7-ab5e-468e-ab75-b7591fb94467-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "cinder-quobyte-e978aaac-c679-45b0-957b-ccf78107ddc3" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-quobyte-e978aaac-c679-45b0-957b-ccf78107ddc3" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "cinder-quobyte-bb3054e7-ab5e-468e-ab75-b7591fb94467" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c295b-4d39-44ed-a2a8-58426593d5ca]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:37 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-bb3054e7-ab5e-468e-ab75-b7591fb94467" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Deleted volume successfully.
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4baa15-69ab-4611-9f46-d38239d44d7e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb843f54-c419-46af-9709-1ea27c1facd5 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-c64aa974-d903-4111-ab54-d81496248f34-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:37 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3
Sep 25 18:37:37 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack sudo[99524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467
Sep 25 18:37:38 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Acquiring lock "cinder-b0921cfd-d927-4787-b3d0-44eaf376e7e7-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "cinder-b0921cfd-d927-4787-b3d0-44eaf376e7e7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:38 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Acquiring lock "cinder-quobyte-b0921cfd-d927-4787-b3d0-44eaf376e7e7" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 1073741824" returned: 0 in 0.567s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "cinder-quobyte-b0921cfd-d927-4787-b3d0-44eaf376e7e7" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:38 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3" returned: 0 in 0.459s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b27452-2554-4b3e-89be-062aaf14ffcb]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack sudo[99534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3
Sep 25 18:37:38 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack sudo[99539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5
Sep 25 18:37:38 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467" returned: 0 in 0.519s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack sudo[99536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7
Sep 25 18:37:38 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack sudo[99542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467
Sep 25 18:37:38 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e978aaac-c679-45b0-957b-ccf78107ddc3" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5" returned: 0 in 0.272s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-quobyte-e978aaac-c679-45b0-957b-ccf78107ddc3" released by "delete_volume" :: held 0.826s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Attempting download of 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 36802462-875a-4729-ac8c-039c135749e5. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Created reservations ['350e3647-f26b-4f41-8e0a-5c7c8c3949d9', 'b1bd30a4-6933-4095-88e3-7e0ed6a2f72c', '41a812e4-0423-4f25-83b5-b9033b5b13b1', 'e0f1a6cc-0290-40a0-b275-1f98dac216aa'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:38 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49f5a9-ca2a-428d-bdc9-ffb4995c2902]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bb3054e7-ab5e-468e-ab75-b7591fb94467" returned: 0 in 0.305s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7" returned: 0 in 0.437s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-quobyte-bb3054e7-ab5e-468e-ab75-b7591fb94467" released by "delete_volume" :: held 0.915s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:38 devstack sudo[99552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7
Sep 25 18:37:38 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth
Sep 25 18:37:38 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Created reservations ['8e8cf4c4-5e56-42da-a6a5-656b1966e5c2', '38c013ed-8301-47cf-b960-f54b922216a5', '9e5fe8b5-6221-43c1-84ce-1097164a0c01', '280ad53c-1fff-42af-ac82-2ea52f7b04ae'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:38 devstack sudo[99555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:38 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:39 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:39 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:39 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b0921cfd-d927-4787-b3d0-44eaf376e7e7" returned: 0 in 0.349s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "cinder-quobyte-b0921cfd-d927-4787-b3d0-44eaf376e7e7" released by "delete_volume" :: held 0.855s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:39 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth" returned: 0 in 0.412s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:39 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.306s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:39 devstack cinder-volume[86534]: WARNING cinder.quota [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:37:39 devstack cinder-volume[86534]: WARNING cinder.quota [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 25 18:37:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Deleted volume successfully.
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Created reservations ['ceb1896e-a77d-408c-beb2-39d0ba01d9fd', '3acb0938-2a3e-4e6a-939f-083412747477', '0f1719c6-40ea-4825-9d1c-10f4fe3cd8ce', 'e5d59e8f-a7a2-4fcb-9afe-c9b92dd46eb4'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-05e1d07e-fbf0-4ab7-a387-cccae0a61153 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-e978aaac-c679-45b0-957b-ccf78107ddc3-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:39 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth
Sep 25 18:37:39 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:39 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Deleted volume successfully.
Sep 25 18:37:39 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:39 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-79a6acd5-4473-45d8-a1c6-5d6d37aa8959 tempest-CinderUnicodeTest-611809852 None] Lock "cinder-bb3054e7-ab5e-468e-ab75-b7591fb94467-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:39 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth" returned: 1 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_jmd9rnth' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5124ec01-49df-46e9-9d41-f0bcdcfbe6f4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:39 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Deleted volume successfully.
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5ceb8af-ddc7-4c0a-b05d-5802aabce7a0 tempest-VolumeAndVolumeTypeFromImageTest-1563687409 None] Lock "cinder-b0921cfd-d927-4787-b3d0-44eaf376e7e7-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:39 devstack sudo[99577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD
Sep 25 18:37:39 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:39 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 was qcow2, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:37:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:39 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5
Sep 25 18:37:39 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "cinder-75d4d4c8-d94c-488d-8cc7-af48c4a9616e-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-75d4d4c8-d94c-488d-8cc7-af48c4a9616e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "cinder-quobyte-75d4d4c8-d94c-488d-8cc7-af48c4a9616e" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-quobyte-75d4d4c8-d94c-488d-8cc7-af48c4a9616e" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ffa57-123a-414e-9edd-7ffe849954c2]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:40 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e
Sep 25 18:37:40 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:40 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e" returned: 0 in 0.477s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:40 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e
Sep 25 18:37:40 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:41 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d4d4c8-d94c-488d-8cc7-af48c4a9616e" returned: 0 in 0.499s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-quobyte-75d4d4c8-d94c-488d-8cc7-af48c4a9616e" released by "delete_volume" :: held 1.044s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Created reservations ['906b59f7-e5ec-4675-bcc5-f7f358903c93', '3f1d6346-48d8-4b2f-a194-e3554b5eb81d', 'f68dc3bc-2e99-4db0-9756-3ddb8d218c02', '2d10611a-66f8-4226-812a-1f70b30aaa9a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:41 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:41 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:41 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Deleted volume successfully.
Sep 25 18:37:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87dcaa19-2480-4c6a-b3d2-9b550c62dd12 tempest-AttachVolumeTestJSON-556297169 None] Lock "cinder-75d4d4c8-d94c-488d-8cc7-af48c4a9616e-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:42 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5" returned: 0 in 2.548s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_49w4kas9devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:37:42 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Converted 112.00 MB image at 43.93 MB/s
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:42 devstack sudo[99606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 1G
Sep 25 18:37:42 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:42 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 1G" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Downloaded image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 36802462-875a-4729-ac8c-039c135749e5 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 for user 21b1b28f73f0402392eaa05f60407f8d is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Marking volume 36802462-875a-4729-ac8c-039c135749e5 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Copying metadata from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 to 36802462-875a-4729-ac8c-039c135749e5. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Creating volume glance metadata for volume 36802462-875a-4729-ac8c-039c135749e5 backed by image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84347411-875d-4d75-8381-333fb2c93666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36802462-875a-4729-ac8c-039c135749e5', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb84465a0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed895a6-a059-430d-a436-c75ed62ebe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Volume volume-36802462-875a-4729-ac8c-039c135749e5 (36802462-875a-4729-ac8c-039c135749e5): created successfully
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed895a6-a059-430d-a436-c75ed62ebe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Flow 'volume_create_manager' (6355bfb1-3682-4a36-a3ce-a6b3109b2bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-834a409d-9ce0-4656-a778-6a00e24abdc9 tempest-VolumesExtendTest-1683211663 None] Created volume successfully.
Sep 25 18:37:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:43 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[89477a60-879e-4b6a-bbaf-58d52bdb2c18]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:43 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5
Sep 25 18:37:43 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:44 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5" returned: 0 in 0.435s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 2G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 2G" returned: 0 in 0.127s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.594s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:44 devstack sudo[99620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:44 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f2efaf74-4c93-4e30-b4e4-1df148d95844 tempest-VolumesExtendTest-1683211663 None] Extend volume completed successfully.
Sep 25 18:37:44 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.292s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:37:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-36802462-875a-4729-ac8c-039c135749e5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-36802462-875a-4729-ac8c-039c135749e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-quobyte-36802462-875a-4729-ac8c-039c135749e5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-36802462-875a-4729-ac8c-039c135749e5" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef81087b-08da-4f7c-ac1b-56f76b262558]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:45 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5
Sep 25 18:37:45 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:45 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5" returned: 0 in 0.376s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:45 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5
Sep 25 18:37:45 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:45 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36802462-875a-4729-ac8c-039c135749e5" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-36802462-875a-4729-ac8c-039c135749e5" released by "delete_volume" :: held 0.671s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:45 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Created reservations ['a948a172-bd1f-41b6-8114-7660e6d0115b', 'f9fdca6d-5d0a-49f9-9bf5-053015c632b3', 'c3c5474e-5c94-4706-9f1d-77f3e2581c99', '67fc52e0-4355-451b-9e75-4c3f04defed0'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:46 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:46 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:46 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.427s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Deleted volume successfully.
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e02c8b49-b206-4f59-a065-ee20cce2a1a1 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-36802462-875a-4729-ac8c-039c135749e5-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Flow 'volume_create_manager' (4bcf819f-f6f9-4a53-bdaa-79c0ca27bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae58309-8816-4869-b524-f2dae50cdcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae58309-8816-4869-b524-f2dae50cdcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-975227716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13eb42-d9e1-4cd9-a9cc-a776168c8a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e34b80e38044d185578dc76288522a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:47Z,use_quota=True,user_id='21b1b28f73f0402392eaa05f60407f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8082a74a-5d8e-4681-9e91-7741a39c2dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8082a74a-5d8e-4681-9e91-7741a39c2dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3259af9f-48a9-4d95-a0f4-a65c2131807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3259af9f-48a9-4d95-a0f4-a65c2131807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d13eb42-d9e1-4cd9-a9cc-a776168c8a36', 'volume_name': 'volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8a95f-ad32-4afc-9d17-dea687996047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b8a95f-ad32-4afc-9d17-dea687996047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82781b6a-eedc-4b75-9323-1376d0702cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Volume 7d13eb42-d9e1-4cd9-a9cc-a776168c8a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36', 'volume_size': 1}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-975227716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13eb42-d9e1-4cd9-a9cc-a776168c8a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e34b80e38044d185578dc76288522a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:47Z,use_quota=True,user_id='21b1b28f73f0402392eaa05f60407f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Creating volume 7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:46 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:47 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 1073741824
Sep 25 18:37:47 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:47 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 1073741824" returned: 0 in 0.595s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:47 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36
Sep 25 18:37:47 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:47 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82781b6a-eedc-4b75-9323-1376d0702cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b27b46-88e6-4540-8994-42a907408689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Volume volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 (7d13eb42-d9e1-4cd9-a9cc-a776168c8a36): created successfully
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b27b46-88e6-4540-8994-42a907408689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Flow 'volume_create_manager' (4bcf819f-f6f9-4a53-bdaa-79c0ca27bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-81407324-ae8d-42cc-98d6-e74f52a9046e tempest-VolumesExtendTest-1683211663 None] Created volume successfully.
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Creating offline snapshot 00021b62-7a06-4d7a-aa84-7e344f30082b of volume 7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6373e1-5b55-4ca5-b24f-9e8414fab5eb]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:49 devstack sudo[99645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36
Sep 25 18:37:49 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:49 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" returned: 0 in 0.381s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:49 devstack sudo[99650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b 1G
Sep 25 18:37:49 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:49 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b 1G" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:50 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b
Sep 25 18:37:50 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:50 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:50 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b is being set with open permissions: ugo+rw
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:50 devstack sudo[99661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b
Sep 25 18:37:50 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Flow 'volume_create_manager' (50555d6b-49e3-472b-a986-d3220f9ba050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f166bfc5-a80f-4633-9388-8b2a02ccd686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f166bfc5-a80f-4633-9388-8b2a02ccd686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1376934762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae6d7d2-6c54-4738-b5ed-71e278f7886b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49ef862952240abaa2c385cb6bca008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:50Z,use_quota=True,user_id='189fd543d7f4410782321d8b0cfd4384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b730077-fac9-40ee-973c-313e99a7728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b730077-fac9-40ee-973c-313e99a7728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc8a339-12aa-457b-bf7a-f7f0da5863c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc8a339-12aa-457b-bf7a-f7f0da5863c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae6d7d2-6c54-4738-b5ed-71e278f7886b', 'volume_name': 'volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba193e7f-f1af-4c95-a888-1ba602b620c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba193e7f-f1af-4c95-a888-1ba602b620c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571dc709-616c-4e9b-8578-ae070f9d7848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:50 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Volume 0ae6d7d2-6c54-4738-b5ed-71e278f7886b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b', 'volume_size': 1}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:50 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:50 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info
Sep 25 18:37:50 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:50 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:50 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info is being set with open permissions: ugo+rw
Sep 25 18:37:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:50 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info
Sep 25 18:37:50 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:51 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.info" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1376934762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae6d7d2-6c54-4738-b5ed-71e278f7886b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49ef862952240abaa2c385cb6bca008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:50Z,use_quota=True,user_id='189fd543d7f4410782321d8b0cfd4384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Creating volume 0ae6d7d2-6c54-4738-b5ed-71e278f7886b {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:51 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:51 devstack sudo[99670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b 1073741824
Sep 25 18:37:51 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:51 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-013fcffb-260a-4088-9f4a-47a168019a73 tempest-VolumesExtendTest-1683211663 None] Create snapshot completed successfully
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:51 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b 1073741824" returned: 0 in 0.461s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:51 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b
Sep 25 18:37:51 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:51 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.479s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571dc709-616c-4e9b-8578-ae070f9d7848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be64fef-3fe7-4621-9a89-13da47dd995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bc337d-8efa-4ff3-9e23-bfe03bc7481d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:51 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Volume volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b (0ae6d7d2-6c54-4738-b5ed-71e278f7886b): created successfully
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be64fef-3fe7-4621-9a89-13da47dd995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Flow 'volume_create_manager' (50555d6b-49e3-472b-a986-d3220f9ba050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:51 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-14c2fcdf-e370-408d-aeb7-c7ebb5146b47 tempest-VolumesTestJSON-2138687493 None] Created volume successfully.
Sep 25 18:37:51 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36
Sep 25 18:37:51 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:52 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b 2G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b 2G" returned: 0 in 0.156s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.556s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8cecb750-0db3-4f44-8962-bd0468f893e9 tempest-VolumesExtendTest-1683211663 None] Extend volume completed successfully.
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Flow 'volume_create_manager' (6840a218-01db-474a-aa60-052573b2df43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7e216e-2b1d-4779-8002-23ebce48fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7e216e-2b1d-4779-8002-23ebce48fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-519185260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a703b181-b251-4f1a-8995-dc473147bd96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49ef862952240abaa2c385cb6bca008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:53Z,use_quota=True,user_id='189fd543d7f4410782321d8b0cfd4384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba4aaf7-4f13-4f13-b4c5-6b7bef630e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba4aaf7-4f13-4f13-b4c5-6b7bef630e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c414e74-c271-4d1e-9045-7feb1dd91460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c414e74-c271-4d1e-9045-7feb1dd91460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a703b181-b251-4f1a-8995-dc473147bd96', 'volume_name': 'volume-a703b181-b251-4f1a-8995-dc473147bd96', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c211e717-7761-4b20-8e65-100cc4482def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c211e717-7761-4b20-8e65-100cc4482def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2398eb-b741-4f22-bdfc-701768c558a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Volume a703b181-b251-4f1a-8995-dc473147bd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a703b181-b251-4f1a-8995-dc473147bd96', 'volume_size': 1}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-519185260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a703b181-b251-4f1a-8995-dc473147bd96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49ef862952240abaa2c385cb6bca008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:53Z,use_quota=True,user_id='189fd543d7f4410782321d8b0cfd4384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Creating volume a703b181-b251-4f1a-8995-dc473147bd96 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:53 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96 1073741824
Sep 25 18:37:53 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:53 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96 1073741824" returned: 0 in 0.423s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:53 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96
Sep 25 18:37:53 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-00021b62-7a06-4d7a-aa84-7e344f30082b-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-00021b62-7a06-4d7a-aa84-7e344f30082b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-quobyte-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-quobyte-00021b62-7a06-4d7a-aa84-7e344f30082b" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-00021b62-7a06-4d7a-aa84-7e344f30082b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Deleting offline snapshot 00021b62-7a06-4d7a-aa84-7e344f30082b of volume 7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] snapshot_file for this snap is: volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0968784-5679-495c-906f-2eea97fcf1b6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:53 devstack sudo[99694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b
Sep 25 18:37:53 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:53 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2398eb-b741-4f22-bdfc-701768c558a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a703b181-b251-4f1a-8995-dc473147bd96', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fba1d8-f368-4d44-9a68-320de8e70cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Volume volume-a703b181-b251-4f1a-8995-dc473147bd96 (a703b181-b251-4f1a-8995-dc473147bd96): created successfully
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7fba1d8-f368-4d44-9a68-320de8e70cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Flow 'volume_create_manager' (6840a218-01db-474a-aa60-052573b2df43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ce13b5e1-e101-4320-b6e0-726c16951c4e tempest-VolumesTestJSON-2138687493 None] Created volume successfully.
Sep 25 18:37:54 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b" returned: 0 in 0.381s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccaf7da-a6da-46a2-8ca6-1d38ca99d59f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:54 devstack sudo[99700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36
Sep 25 18:37:54 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:54 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" returned: 0 in 0.408s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:37:54 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b
Sep 25 18:37:54 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Flow 'volume_create_manager' (4799e256-3877-4b1a-9b93-e5161ce8e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cda0fd-1568-4825-8240-3a272ed6af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cda0fd-1568-4825-8240-3a272ed6af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1913349937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd716d66-50d0-4c57-b603-793dd88d8b77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49ef862952240abaa2c385cb6bca008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:55Z,use_quota=True,user_id='189fd543d7f4410782321d8b0cfd4384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33789faa-c314-4960-9ff5-147bda19f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33789faa-c314-4960-9ff5-147bda19f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b5e0d2-6ebf-4835-ab9a-dddf25a6260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b5e0d2-6ebf-4835-ab9a-dddf25a6260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd716d66-50d0-4c57-b603-793dd88d8b77', 'volume_name': 'volume-fd716d66-50d0-4c57-b603-793dd88d8b77', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b84c2-461f-43c8-858a-b4fde5d0ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2b84c2-461f-43c8-858a-b4fde5d0ad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9df883-af38-4ae1-bfaf-b55ed9e67cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Volume fd716d66-50d0-4c57-b603-793dd88d8b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd716d66-50d0-4c57-b603-793dd88d8b77', 'volume_size': 1}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1913349937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd716d66-50d0-4c57-b603-793dd88d8b77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b49ef862952240abaa2c385cb6bca008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:37:55Z,use_quota=True,user_id='189fd543d7f4410782321d8b0cfd4384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Creating volume fd716d66-50d0-4c57-b603-793dd88d8b77 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:37:54 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:54 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77 1073741824
Sep 25 18:37:54 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:54 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:54 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b
Sep 25 18:37:54 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:55 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77 1073741824" returned: 0 in 0.454s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:55 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77
Sep 25 18:37:55 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:55 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36.00021b62-7a06-4d7a-aa84-7e344f30082b" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-00021b62-7a06-4d7a-aa84-7e344f30082b" released by "_delete_snapshot" :: held 1.557s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" released by "delete_snapshot" :: held 1.579s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Created reservations ['1e2fa578-2d58-443d-9a3a-b3764f26f472', 'cdf79db8-0d2a-4277-bb49-04f371a2e671', '6e1f4069-80dd-4ea7-a992-26d73fb15bb5', '50ac6442-3a94-4681-9831-0cac7cc2e6d5'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Delete snapshot completed successfully.
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d2844f52-7ef4-446b-8a7f-9af5240e7333 tempest-VolumesExtendTest-1683211663 None] Lock "cinder-00021b62-7a06-4d7a-aa84-7e344f30082b-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:55 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9df883-af38-4ae1-bfaf-b55ed9e67cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd716d66-50d0-4c57-b603-793dd88d8b77', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19a3086-17c2-4b46-a5ed-5eb1508aa59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:37:55 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Volume volume-fd716d66-50d0-4c57-b603-793dd88d8b77 (fd716d66-50d0-4c57-b603-793dd88d8b77): created successfully
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19a3086-17c2-4b46-a5ed-5eb1508aa59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Flow 'volume_create_manager' (4799e256-3877-4b1a-9b93-e5161ce8e173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:37:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-71ed4479-443c-4384-999f-30e9635d107a tempest-VolumesTestJSON-2138687493 None] Created volume successfully.
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Lock "cinder-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Acquiring lock "cinder-quobyte-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a94201f-137c-49b4-a552-15f558206e28]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:56 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36
Sep 25 18:37:56 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:56 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" returned: 0 in 0.381s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Acquiring lock "cinder-fd716d66-50d0-4c57-b603-793dd88d8b77-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:56 devstack sudo[99726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36
Sep 25 18:37:56 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Lock "cinder-fd716d66-50d0-4c57-b603-793dd88d8b77-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Acquiring lock "cinder-quobyte-fd716d66-50d0-4c57-b603-793dd88d8b77" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Lock "cinder-quobyte-fd716d66-50d0-4c57-b603-793dd88d8b77" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[392bcfb0-d022-4760-8591-90439cb60bc4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:56 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77
Sep 25 18:37:56 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:56 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Lock "cinder-quobyte-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36" released by "delete_volume" :: held 0.703s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Created reservations ['83cc8f3b-f62d-464a-b8b8-0a2bdc01680f', 'ccb8234b-1e92-4e99-a718-91fbe3dba636', 'ad26b2ea-bd9b-4338-88bc-ceb39302dd3f', 'a96a76f3-7f74-4220-a4db-ed0f693d9f90'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:56 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:56 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:56 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:56 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77
Sep 25 18:37:56 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:57 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.271s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Deleted volume successfully.
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d29e7601-680e-4383-96d3-5b41d53041ba tempest-VolumesExtendTest-1683211663 None] Lock "cinder-7d13eb42-d9e1-4cd9-a9cc-a776168c8a36-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:57 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fd716d66-50d0-4c57-b603-793dd88d8b77" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Lock "cinder-quobyte-fd716d66-50d0-4c57-b603-793dd88d8b77" released by "delete_volume" :: held 0.701s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Created reservations ['143c6c56-7f24-4ca3-8f38-d6b6b133ff4e', '1d38fa40-f4b1-4f1f-a237-ea9e4ae00c3d', 'fcec9281-014c-47fe-8f69-0d601359338f', 'dee425da-0ba2-440c-8d42-97a164a88607'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:57 devstack sudo[99740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:57 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:57 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Deleted volume successfully.
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "cinder-a703b181-b251-4f1a-8995-dc473147bd96-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-a703b181-b251-4f1a-8995-dc473147bd96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-953d498a-22a9-4111-8700-318eb17907ae tempest-VolumesTestJSON-2138687493 None] Lock "cinder-fd716d66-50d0-4c57-b603-793dd88d8b77-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "cinder-quobyte-a703b181-b251-4f1a-8995-dc473147bd96" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-quobyte-a703b181-b251-4f1a-8995-dc473147bd96" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb3e7e5-d590-4268-96b2-08d2ee139440]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:57 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96
Sep 25 18:37:57 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:58 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:58 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96
Sep 25 18:37:58 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:58 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a703b181-b251-4f1a-8995-dc473147bd96" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-quobyte-a703b181-b251-4f1a-8995-dc473147bd96" released by "delete_volume" :: held 0.712s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=211,cinder:SELECT=166,cinder:INSERT=61,cinder:DELETE=22 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=173,cinder:UPDATE=218,cinder:DELETE=13,cinder:INSERT=61 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Created reservations ['ef5e040b-5e68-4923-bd1f-85e10f50e209', '3528e849-428f-4c02-851d-bb68a1367f1b', '7374c12f-7930-461e-a662-6b6f2a7654ad', '2d7f8a2c-4e28-4492-be1d-9f75fb5ace4e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:58 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:58 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "cinder-0ae6d7d2-6c54-4738-b5ed-71e278f7886b-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-0ae6d7d2-6c54-4738-b5ed-71e278f7886b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:58 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.298s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Deleted volume successfully.
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "cinder-quobyte-0ae6d7d2-6c54-4738-b5ed-71e278f7886b" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-quobyte-0ae6d7d2-6c54-4738-b5ed-71e278f7886b" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa56b178-1b41-4a8f-8274-5d7aceba73a7 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-a703b181-b251-4f1a-8995-dc473147bd96-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bab779-f517-433a-bbe8-67876787605a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:37:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:58 devstack sudo[99754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b
Sep 25 18:37:58 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:59 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:59 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b
Sep 25 18:37:59 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:59 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0ae6d7d2-6c54-4738-b5ed-71e278f7886b" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-quobyte-0ae6d7d2-6c54-4738-b5ed-71e278f7886b" released by "delete_volume" :: held 0.695s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Created reservations ['973bea01-571d-41c3-9f5c-da83b7939672', 'fd2bab24-51d6-4ae1-925c-194f1b2c2da2', 'eb2e09cb-64b5-45b9-9b2c-b9a31a495d32', '7a03e8d3-9beb-4137-8f73-4b4e1dd63bfa'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:37:59 devstack sudo[99764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:37:59 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:37:59 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:37:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Deleted volume successfully.
Sep 25 18:37:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7f8c6b2b-357f-470c-ad7d-516289698672 tempest-VolumesTestJSON-2138687493 None] Lock "cinder-0ae6d7d2-6c54-4738-b5ed-71e278f7886b-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:00 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (f921aab9-65d8-43e0-940b-eda4401b4367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1398673-7948-41a3-b03d-f5973f675e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1398673-7948-41a3-b03d-f5973f675e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1412288799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a0c42c-9a2d-40d7-908c-5ac360e960cc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:01Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d9d5eb-15f2-4f88-b8ff-0f56291b09f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d9d5eb-15f2-4f88-b8ff-0f56291b09f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924204a9-c482-4cac-8459-5c808527a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924204a9-c482-4cac-8459-5c808527a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a0c42c-9a2d-40d7-908c-5ac360e960cc', 'volume_name': 'volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9c5466-72b0-4a73-b6b0-4bd015348fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9c5466-72b0-4a73-b6b0-4bd015348fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ff95c1-1a2c-45ad-abbd-3bbc8434b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:01 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Volume c2a0c42c-9a2d-40d7-908c-5ac360e960cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc', 'volume_size': 1}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1412288799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a0c42c-9a2d-40d7-908c-5ac360e960cc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:01Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Creating volume c2a0c42c-9a2d-40d7-908c-5ac360e960cc {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:01 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:01 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc 1073741824
Sep 25 18:38:01 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:01 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc 1073741824" returned: 0 in 0.465s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:01 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc
Sep 25 18:38:01 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:01 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc" returned: 0 in 0.254s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ff95c1-1a2c-45ad-abbd-3bbc8434b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc49d0d-dc0b-4672-93de-64d75bdb837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:01 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Volume volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc (c2a0c42c-9a2d-40d7-908c-5ac360e960cc): created successfully
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc49d0d-dc0b-4672-93de-64d75bdb837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (f921aab9-65d8-43e0-940b-eda4401b4367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a2e79a01-877f-4708-aba1-aab27207fb91 tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:02 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (042a2258-4a7c-41a8-9bdb-42e3fd2caecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236dbd40-5849-48e3-9016-21226c94da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236dbd40-5849-48e3-9016-21226c94da0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2066410693',display_name='tempest-VolumesGetTest-Volume-1862525088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7a7642-5b23-4909-badb-c6d146e48382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:03Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d35e64-3d3e-4aff-8429-512074033613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d35e64-3d3e-4aff-8429-512074033613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5662cc9d-cd08-4f20-ae2c-cc967e369f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5662cc9d-cd08-4f20-ae2c-cc967e369f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7a7642-5b23-4909-badb-c6d146e48382', 'volume_name': 'volume-3c7a7642-5b23-4909-badb-c6d146e48382', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20da18b-6591-4cf2-911a-e380091ae1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20da18b-6591-4cf2-911a-e380091ae1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c89b52-5f24-429f-9344-4e23c6fd2ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Volume 3c7a7642-5b23-4909-badb-c6d146e48382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7a7642-5b23-4909-badb-c6d146e48382', 'volume_size': 1}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2066410693',display_name='tempest-VolumesGetTest-Volume-1862525088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7a7642-5b23-4909-badb-c6d146e48382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:03Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Creating volume 3c7a7642-5b23-4909-badb-c6d146e48382 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:03 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:03 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382 1073741824
Sep 25 18:38:03 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:03 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382 1073741824" returned: 0 in 0.472s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:03 devstack sudo[99785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382
Sep 25 18:38:03 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:03 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c89b52-5f24-429f-9344-4e23c6fd2ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7a7642-5b23-4909-badb-c6d146e48382', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9c3de2-f9ff-4aff-a85f-dcfac50a939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Volume volume-3c7a7642-5b23-4909-badb-c6d146e48382 (3c7a7642-5b23-4909-badb-c6d146e48382): created successfully
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9c3de2-f9ff-4aff-a85f-dcfac50a939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (042a2258-4a7c-41a8-9bdb-42e3fd2caecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-11a00fa1-fc75-4019-b2fb-e83dbdf29ce0 tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-3c7a7642-5b23-4909-badb-c6d146e48382-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Lock "cinder-3c7a7642-5b23-4909-badb-c6d146e48382-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-3c7a7642-5b23-4909-badb-c6d146e48382" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-3c7a7642-5b23-4909-badb-c6d146e48382" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2298969c-8135-4a84-902e-41ef4cb7d039]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:04 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382
Sep 25 18:38:04 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:04 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:04 devstack sudo[99793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382
Sep 25 18:38:04 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:04 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3c7a7642-5b23-4909-badb-c6d146e48382" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-3c7a7642-5b23-4909-badb-c6d146e48382" released by "delete_volume" :: held 0.689s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Created reservations ['ab6b4289-d63e-4798-8c30-eeeedabc491a', '45cf41e6-05b8-47a1-bf91-452838cf4c89', 'af11460f-5633-4c84-95ec-67adff7cf992', '558b556f-9a47-44f9-aae4-8dad6724a7bc'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:05 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:05 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:05 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.304s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1b7e73b5-7bd4-433d-8250-afcc2e6198b2 tempest-VolumesGetTest-118225911 None] Lock "cinder-3c7a7642-5b23-4909-badb-c6d146e48382-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-c2a0c42c-9a2d-40d7-908c-5ac360e960cc-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Lock "cinder-c2a0c42c-9a2d-40d7-908c-5ac360e960cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-c2a0c42c-9a2d-40d7-908c-5ac360e960cc" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-c2a0c42c-9a2d-40d7-908c-5ac360e960cc" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03dba8e-6a02-4f94-a94b-96d3564e0b0c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:05 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc
Sep 25 18:38:05 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:05 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc" returned: 0 in 0.385s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:05 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc
Sep 25 18:38:05 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:06 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c2a0c42c-9a2d-40d7-908c-5ac360e960cc" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-c2a0c42c-9a2d-40d7-908c-5ac360e960cc" released by "delete_volume" :: held 0.689s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Created reservations ['d49ae86e-c42b-4ffc-bfda-20361df96eec', '54009235-b3e7-4901-8ce3-776e04053637', 'b8d722fd-1f20-4d9a-97ec-45630a898471', 'ffd4a940-e6b6-48c5-ab55-c98ac142802f'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:06 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:06 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:06 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-61ee7ee5-a13f-4546-b295-fd7b4f1b5339 tempest-VolumesGetTest-118225911 None] Lock "cinder-c2a0c42c-9a2d-40d7-908c-5ac360e960cc-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (94278eb5-671d-417a-abc0-6c16973617e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5565d138-8f6f-411a-ab5e-d73de3fcc072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5565d138-8f6f-411a-ab5e-d73de3fcc072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1643631537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c7dc2a-8248-4100-9493-4192314ac534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:07Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871cf4de-6989-4c81-95a0-6e2e61654a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871cf4de-6989-4c81-95a0-6e2e61654a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31e5c9b-1ced-4736-af9f-bf731e018e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31e5c9b-1ced-4736-af9f-bf731e018e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c7dc2a-8248-4100-9493-4192314ac534', 'volume_name': 'volume-10c7dc2a-8248-4100-9493-4192314ac534', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df441f0c-3f41-4b4e-ac62-46a3d5465ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df441f0c-3f41-4b4e-ac62-46a3d5465ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2cbf19-6156-4bdf-85f3-48393b46e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Volume 10c7dc2a-8248-4100-9493-4192314ac534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c7dc2a-8248-4100-9493-4192314ac534', 'volume_size': 1}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1643631537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c7dc2a-8248-4100-9493-4192314ac534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:07Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Creating volume 10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:07 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:07 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 1073741824
Sep 25 18:38:07 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:07 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 1073741824" returned: 0 in 0.457s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:07 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534
Sep 25 18:38:07 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Flow 'volume_create_manager' (679afcfc-0bfa-46b4-b2c3-11e1902191e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:07 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b684f02f-91da-4177-b4cd-2cfbab6d9390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534" returned: 0 in 0.279s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b684f02f-91da-4177-b4cd-2cfbab6d9390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1879333511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6db17f-36db-456f-9af9-2ce3c1dbdcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afea604100d4f63bd1407f4628924e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:08Z,use_quota=True,user_id='e933f4f1ad864c49981d7b7f2fcac295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8398048-6813-419b-8242-e6970f4f4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8398048-6813-419b-8242-e6970f4f4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7607ebfb-f7fd-4558-b7b9-9b042007e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7607ebfb-f7fd-4558-b7b9-9b042007e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa6db17f-36db-456f-9af9-2ce3c1dbdcff', 'volume_name': 'volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92126d01-d1cf-4b51-8c63-be90cf5edde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92126d01-d1cf-4b51-8c63-be90cf5edde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0317a85e-ab92-482f-a823-e957984f9ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff', 'volume_size': 1}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1879333511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6db17f-36db-456f-9af9-2ce3c1dbdcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afea604100d4f63bd1407f4628924e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:08Z,use_quota=True,user_id='e933f4f1ad864c49981d7b7f2fcac295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Creating volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:07 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2cbf19-6156-4bdf-85f3-48393b46e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c7dc2a-8248-4100-9493-4192314ac534', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69aaa851-f1d7-478a-9a09-3f0a72c7a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:08 devstack sudo[99819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff 1073741824
Sep 25 18:38:08 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Volume volume-10c7dc2a-8248-4100-9493-4192314ac534 (10c7dc2a-8248-4100-9493-4192314ac534): created successfully
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69aaa851-f1d7-478a-9a09-3f0a72c7a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (94278eb5-671d-417a-abc0-6c16973617e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fe56a518-e87f-4c77-b2c9-e3043f52c8d2 tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:08 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff 1073741824" returned: 0 in 0.422s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:08 devstack sudo[99825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff
Sep 25 18:38:08 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:08 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0317a85e-ab92-482f-a823-e957984f9ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cf81a4-fbba-48b5-b8cf-03e210edd0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:08 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Volume volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff (aa6db17f-36db-456f-9af9-2ce3c1dbdcff): created successfully
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cf81a4-fbba-48b5-b8cf-03e210edd0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:08 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Flow 'volume_create_manager' (679afcfc-0bfa-46b4-b2c3-11e1902191e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b1525c2d-f1a9-4cff-be33-34f88d58abe8 tempest-SnapshotsActionsTest-833038338 None] Created volume successfully.
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Creating offline snapshot ee2d393b-43c2-4723-a5d0-ad7891a9a89e of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05be75f-56dd-4c4f-a407-57e476b4d9fd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:09 devstack sudo[99828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff
Sep 25 18:38:09 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:09 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" returned: 0 in 0.401s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:09 devstack sudo[99834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e 1G
Sep 25 18:38:09 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (c89e2810-8d9b-4017-a0c2-d85e0f1c1cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb86093a-b8c4-4cd0-93fb-27f3727c04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb86093a-b8c4-4cd0-93fb-27f3727c04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2020550165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ced409-cf6b-4c99-9b82-7415c88fb276,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=10c7dc2a-8248-4100-9493-4192314ac534,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:10Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587983ba-67ef-4115-b0a4-16449813d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587983ba-67ef-4115-b0a4-16449813d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb30976-2090-447c-b204-a92e8c4e5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb30976-2090-447c-b204-a92e8c4e5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '18ced409-cf6b-4c99-9b82-7415c88fb276', 'volume_name': 'volume-18ced409-cf6b-4c99-9b82-7415c88fb276', 'volume_size': 1, 'source_volid': '10c7dc2a-8248-4100-9493-4192314ac534', 'source_volstatus': 'available'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59710892-054c-42c1-a6e2-f1a1d2d38162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59710892-054c-42c1-a6e2-f1a1d2d38162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d34df79-ac8d-4a77-bf14-172485c12682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:09 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Volume 18ced409-cf6b-4c99-9b82-7415c88fb276: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-18ced409-cf6b-4c99-9b82-7415c88fb276', 'volume_size': 1, 'source_volid': '10c7dc2a-8248-4100-9493-4192314ac534', 'source_volstatus': 'available'}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:09 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e 1G" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:09 devstack sudo[99839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:09 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:10 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:10 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e is being set with open permissions: ugo+rw
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:10 devstack sudo[99844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:10 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:10 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:10 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info
Sep 25 18:38:10 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:10 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:10 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info is being set with open permissions: ugo+rw
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:10 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info
Sep 25 18:38:10 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:10 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.info" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.205s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:10 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Cloning volume 10c7dc2a-8248-4100-9493-4192314ac534 to volume 18ced409-cf6b-4c99-9b82-7415c88fb276
Sep 25 18:38:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-dc28fc1d-93c7-469a-acd9-5f7a69853435 tempest-SnapshotsActionsTest-833038338 None] Create snapshot completed successfully
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Creating offline snapshot 7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 of volume 10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e647afa-90e2-44a1-b777-6b2e3dc1d28e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:11 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534
Sep 25 18:38:11 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:11 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534" returned: 0 in 0.391s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:11 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 1G
Sep 25 18:38:11 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:11 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 1G" returned: 0 in 0.403s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c7dc2a-8248-4100-9493-4192314ac534 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:11 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c7dc2a-8248-4100-9493-4192314ac534 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7
Sep 25 18:38:11 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:12 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c7dc2a-8248-4100-9493-4192314ac534 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" returned: 0 in 0.310s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:12 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 is being set with open permissions: ugo+rw
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:12 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7
Sep 25 18:38:12 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:12 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:12 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info
Sep 25 18:38:12 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:12 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:12 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info is being set with open permissions: ugo+rw
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:12 devstack sudo[99878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info
Sep 25 18:38:12 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:12 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.info" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-18ced409-cf6b-4c99-9b82-7415c88fb276" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-18ced409-cf6b-4c99-9b82-7415c88fb276" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] snapshot: 7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7, volume: 18ced409-cf6b-4c99-9b82-7415c88fb276,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a30236d-ab15-4c0e-8c6b-7a53be3727d4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:13 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7
Sep 25 18:38:13 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:13 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" returned: 0 in 0.362s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10c7dc2a-8248-4100-9493-4192314ac534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4518fcd-ff7d-44ac-b24f-28e5db4788d0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:13 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534
Sep 25 18:38:13 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:13 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534" returned: 0 in 0.355s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:38:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:13 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276
Sep 25 18:38:13 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:19 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276" returned: 0 in 5.950s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:38:19 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Converted 1024.00 MB image at 172.05 MB/s
Sep 25 18:38:19 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 is being set with open permissions: ugo+rw
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:19 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276
Sep 25 18:38:19 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:19 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-18ced409-cf6b-4c99-9b82-7415c88fb276" released by "_copy_volume_from_snapshot" :: held 6.980s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Deleting offline snapshot 7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 of volume 10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] snapshot_file for this snap is: volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3998c-8fa0-4253-b356-9636410f1725]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:20 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7
Sep 25 18:38:20 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:20 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" returned: 0 in 0.371s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10c7dc2a-8248-4100-9493-4192314ac534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:20 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44740d4-7c37-4653-af60-823502c0814e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:20 devstack sudo[99915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534
Sep 25 18:38:20 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:20 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534" returned: 0 in 0.539s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:20 devstack sudo[99920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7
Sep 25 18:38:20 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:21 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" returned: 0 in 0.318s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:21 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7
Sep 25 18:38:21 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:21 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534.7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-7df2f26f-26c5-4ce7-8ac0-1f313a7ef4b7" released by "_delete_snapshot" :: held 1.555s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.580s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.887s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d34df79-ac8d-4a77-bf14-172485c12682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ced409-cf6b-4c99-9b82-7415c88fb276', 'volume_size': 1, 'source_volid': '10c7dc2a-8248-4100-9493-4192314ac534', 'source_volstatus': 'available'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96962293-34b3-4b74-9f2f-5ae33562d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Creating offline snapshot 64833fb8-ccca-4a87-960c-475f97d5c452 of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:21 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Volume volume-18ced409-cf6b-4c99-9b82-7415c88fb276 (18ced409-cf6b-4c99-9b82-7415c88fb276): created successfully
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96962293-34b3-4b74-9f2f-5ae33562d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (c89e2810-8d9b-4017-a0c2-d85e0f1c1cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[13705402-4a29-4c72-97ab-9c44297e36bf]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0c09d189-8b8a-4bf8-9392-3fa14c43653f tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:21 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:21 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:21 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.352s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:21 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 1G
Sep 25 18:38:21 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:22 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 1G" returned: 0 in 0.410s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:22 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452
Sep 25 18:38:22 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:22 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452" returned: 0 in 0.293s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:22 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 is being set with open permissions: ugo+rw
Sep 25 18:38:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:22 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452
Sep 25 18:38:22 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:22 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.438s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-932749c3-c771-4164-92b2-81949257ca7a tempest-SnapshotsActionsTest-833038338 None] Create snapshot completed successfully
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (47b57944-8176-427e-8119-847a2a2bd3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd6ca76-717a-413c-9e82-0a0dfd99caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd6ca76-717a-413c-9e82-0a0dfd99caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-399995549',display_name='tempest-VolumesGetTest-Volume-400452397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b42ccb1-92cb-402c-adf4-18d97842e22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:23Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc2ef29-c3bc-4b06-9f4e-e9a3ef72b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc2ef29-c3bc-4b06-9f4e-e9a3ef72b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f279d7d9-aeb7-46cd-b096-740cac4807f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f279d7d9-aeb7-46cd-b096-740cac4807f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b42ccb1-92cb-402c-adf4-18d97842e22f', 'volume_name': 'volume-4b42ccb1-92cb-402c-adf4-18d97842e22f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e614dbae-a190-4908-867b-1506dc43736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e614dbae-a190-4908-867b-1506dc43736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea21078-9194-416f-b3a9-dd1e7a487478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:23 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Volume 4b42ccb1-92cb-402c-adf4-18d97842e22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b42ccb1-92cb-402c-adf4-18d97842e22f', 'volume_size': 1}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-399995549',display_name='tempest-VolumesGetTest-Volume-400452397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b42ccb1-92cb-402c-adf4-18d97842e22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:23Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Creating volume 4b42ccb1-92cb-402c-adf4-18d97842e22f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:23 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-64833fb8-ccca-4a87-960c-475f97d5c452-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:23 devstack sudo[99948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f 1073741824
Sep 25 18:38:23 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-64833fb8-ccca-4a87-960c-475f97d5c452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-64833fb8-ccca-4a87-960c-475f97d5c452" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-64833fb8-ccca-4a87-960c-475f97d5c452" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Deleting offline snapshot 64833fb8-ccca-4a87-960c-475f97d5c452 of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] snapshot_file for this snap is: volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7793459b-9e4f-4266-a16a-aab2e46a3efd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:23 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452
Sep 25 18:38:23 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:23 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f 1073741824" returned: 0 in 0.441s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:23 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:23 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452" returned: 0 in 0.391s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:23 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556d00f-0cd3-478e-8db2-d39aee74c86b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:23 devstack sudo[99960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:23 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:24 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea21078-9194-416f-b3a9-dd1e7a487478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b42ccb1-92cb-402c-adf4-18d97842e22f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e4ead3-caa7-4bca-9497-da89b99fb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Volume volume-4b42ccb1-92cb-402c-adf4-18d97842e22f (4b42ccb1-92cb-402c-adf4-18d97842e22f): created successfully
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e4ead3-caa7-4bca-9497-da89b99fb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (47b57944-8176-427e-8119-847a2a2bd3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1df21594-32b1-4789-9182-199e139cfc0d tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:24 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.366s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:24 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452
Sep 25 18:38:24 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-4b42ccb1-92cb-402c-adf4-18d97842e22f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Lock "cinder-4b42ccb1-92cb-402c-adf4-18d97842e22f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-4b42ccb1-92cb-402c-adf4-18d97842e22f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-4b42ccb1-92cb-402c-adf4-18d97842e22f" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f3409d-d1b1-45f0-9785-86a19521c8fd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:24 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f
Sep 25 18:38:24 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:24 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452" returned: 0 in 0.378s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:24 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452
Sep 25 18:38:24 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:24 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f" returned: 0 in 0.366s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:24 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.64833fb8-ccca-4a87-960c-475f97d5c452" returned: 0 in 0.252s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:24 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f
Sep 25 18:38:24 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-64833fb8-ccca-4a87-960c-475f97d5c452" released by "_delete_snapshot" :: held 1.489s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" released by "delete_snapshot" :: held 1.512s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Created reservations ['252ac6cb-1184-43e0-8ea9-d68f0c86f315', '6a8031c9-772e-4b7f-bd2d-d3894a2d52df', '36d30387-fe95-48f0-a5e3-df4fe43d6963', '2ec927ab-3533-456e-a62b-db861172ab39'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Delete snapshot completed successfully.
Sep 25 18:38:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1a445da3-f281-41e3-8d53-263e8b7682d4 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-64833fb8-ccca-4a87-960c-475f97d5c452-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:25 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4b42ccb1-92cb-402c-adf4-18d97842e22f" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-4b42ccb1-92cb-402c-adf4-18d97842e22f" released by "delete_volume" :: held 0.663s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Created reservations ['dc9d0e19-c452-450d-ae7f-97d73e8fe4c9', 'eb8e17cc-ff7f-406c-841d-53f5d242bfb1', '1387b71f-5536-42fd-8324-1a37cde3d5a7', '6745bc1f-c958-4364-90f6-f53de6f3d6ae'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:25 devstack sudo[99983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:25 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:25 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc8f7f6b-5a32-4828-a340-13c6f76fce85 tempest-VolumesGetTest-118225911 None] Lock "cinder-4b42ccb1-92cb-402c-adf4-18d97842e22f-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-18ced409-cf6b-4c99-9b82-7415c88fb276-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Lock "cinder-18ced409-cf6b-4c99-9b82-7415c88fb276-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-18ced409-cf6b-4c99-9b82-7415c88fb276" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-18ced409-cf6b-4c99-9b82-7415c88fb276" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[062277a3-4fb5-42dc-8411-b311f4a78d32]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Creating offline snapshot 25766181-aa1f-4e95-a59d-06d136b8c023 of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:25 devstack sudo[99987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276
Sep 25 18:38:25 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b27ec-d16f-4b36-ab85-d08f072eaf5b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:25 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:25 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:26 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:26 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276
Sep 25 18:38:26 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:26 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:26 devstack sudo[99999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 1G
Sep 25 18:38:26 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:26 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-18ced409-cf6b-4c99-9b82-7415c88fb276" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-18ced409-cf6b-4c99-9b82-7415c88fb276" released by "delete_volume" :: held 0.691s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Created reservations ['917f8e2c-d8c9-4cf1-a557-c8000dc03544', 'dc168c28-9835-422a-883e-b579da085969', 'd6e63500-c1d1-4b9c-bebb-40af4fa97701', '364a8324-9202-492c-b1c3-9f0a52a10734'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:26 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:26 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:26 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 1G" returned: 0 in 0.473s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:26 devstack sudo[100008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023
Sep 25 18:38:26 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:26 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.274s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8d8d0531-62f5-4b44-8cbb-07d491b13ec7 tempest-VolumesGetTest-118225911 None] Lock "cinder-18ced409-cf6b-4c99-9b82-7415c88fb276-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-10c7dc2a-8248-4100-9493-4192314ac534-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Lock "cinder-10c7dc2a-8248-4100-9493-4192314ac534-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-10c7dc2a-8248-4100-9493-4192314ac534" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-10c7dc2a-8248-4100-9493-4192314ac534" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78ae78-99f7-4c6e-a0eb-ad55fe92c7a3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:27 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:27 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 is being set with open permissions: ugo+rw
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:27 devstack sudo[100010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534
Sep 25 18:38:27 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:27 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023
Sep 25 18:38:27 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:27 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023" returned: 0 in 0.258s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:27 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:27 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534
Sep 25 18:38:27 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.565s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9e37578e-dfe4-4047-9478-a534b4a6c235 tempest-SnapshotsActionsTest-833038338 None] Create snapshot completed successfully
Sep 25 18:38:27 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-10c7dc2a-8248-4100-9493-4192314ac534" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-10c7dc2a-8248-4100-9493-4192314ac534" released by "delete_volume" :: held 0.687s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Created reservations ['f6fc5d60-aca2-4210-9028-4d7de6f1b5b3', 'c9d74354-3ec2-4a98-a9e1-7de0d6aceb9a', '06094d73-1ff1-49c0-9417-997523dd2b4f', '5f427470-e6a6-4220-8627-dc73ad8a7110'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:27 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:27 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:27 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3e8abfea-85d2-45b1-aba1-39e96dfb794e tempest-VolumesGetTest-118225911 None] Lock "cinder-10c7dc2a-8248-4100-9493-4192314ac534-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-25766181-aa1f-4e95-a59d-06d136b8c023-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-25766181-aa1f-4e95-a59d-06d136b8c023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-25766181-aa1f-4e95-a59d-06d136b8c023" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-25766181-aa1f-4e95-a59d-06d136b8c023" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Deleting offline snapshot 25766181-aa1f-4e95-a59d-06d136b8c023 of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] snapshot_file for this snap is: volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb3f63f-3013-4186-9f09-8cbddbe42be7]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:28 devstack sudo[100027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023
Sep 25 18:38:28 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:28 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023" returned: 0 in 0.388s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91be617-4bee-42a6-a285-d8c507bddedd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:28 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:28 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (2574daaa-c2e2-47d9-870e-f27aa4ab638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3c177a-805f-4f6b-a526-b4edda8ee76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3c177a-805f-4f6b-a526-b4edda8ee76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1230347575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23690f3a-d0e0-4018-935d-aefa7bece0f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:29Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44321e9-c490-402d-b1f0-541b2921eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44321e9-c490-402d-b1f0-541b2921eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d114c243-68d7-4631-88c2-065bbf0916ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:38:28 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.391s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:28 devstack sudo[100037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023
Sep 25 18:38:28 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d114c243-68d7-4631-88c2-065bbf0916ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23690f3a-d0e0-4018-935d-aefa7bece0f1', 'volume_name': 'volume-23690f3a-d0e0-4018-935d-aefa7bece0f1', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7d5ac90>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98746931-1be4-4ef0-b587-833f6ffb7601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98746931-1be4-4ef0-b587-833f6ffb7601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3e1f86-6866-4b9c-9cb1-0460e8f00e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Volume 23690f3a-d0e0-4018-935d-aefa7bece0f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23690f3a-d0e0-4018-935d-aefa7bece0f1', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7d5ac90>}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Trying to clone 23690f3a-d0e0-4018-935d-aefa7bece0f1 from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:38:29 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:29 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023
Sep 25 18:38:29 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:38:29 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8118ab-26ed-4cea-b9ff-950375725650]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:29 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.25766181-aa1f-4e95-a59d-06d136b8c023" returned: 0 in 0.322s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-25766181-aa1f-4e95-a59d-06d136b8c023" released by "_delete_snapshot" :: held 1.648s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:29 devstack sudo[100082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD
Sep 25 18:38:29 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" released by "delete_snapshot" :: held 1.669s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Created reservations ['5a51f754-3b8b-4be4-b179-74ca5b0e3627', '046c01e6-fb9c-4cee-bba8-8d0bd3e478a2', 'ed1695c3-3ea0-4fce-9f91-be6c0af24eaf', 'cd847d0a-c7f5-46b7-b8df-4b0c95f4ac5b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Delete snapshot completed successfully.
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53bdf244-ad4e-41ba-b87a-ac3d5030e98b tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-25766181-aa1f-4e95-a59d-06d136b8c023-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:29 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 is fetched for user eeaf367170cf40b2807edbd78ea3c75c. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fc2886-3d46-4439-b950-b219ee0c3c99]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:30 devstack sudo[100088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD
Sep 25 18:38:30 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:30 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1230347575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23690f3a-d0e0-4018-935d-aefa7bece0f1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:29Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Creating volume 23690f3a-d0e0-4018-935d-aefa7bece0f1 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:30 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:30 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 1073741824
Sep 25 18:38:30 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:30 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 1073741824" returned: 0 in 0.431s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:30 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1
Sep 25 18:38:30 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:31 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.603s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Creating offline snapshot 5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Attempting download of 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 23690f3a-d0e0-4018-935d-aefa7bece0f1. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d033b5-0543-4e4b-a77a-a71be0b2369b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914fa52-6e44-4397-b110-368a8874bb86]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:31 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:31 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:31 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu
Sep 25 18:38:31 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:31 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:31 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:31 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de 1G
Sep 25 18:38:31 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:31 devstack sudo[100111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu
Sep 25 18:38:31 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:31 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu" returned: 1 in 0.337s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_z1w3nccu' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ee146-4e1d-4cc7-97f9-5d7735fcbe61]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:31 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de 1G" returned: 0 in 0.453s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:31 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD
Sep 25 18:38:31 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:31 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de
Sep 25 18:38:31 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:32 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 was qcow2, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:32 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1
Sep 25 18:38:32 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:32 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" returned: 0 in 0.304s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de is being set with open permissions: ugo+rw
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:32 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de
Sep 25 18:38:32 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:32 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" returned: 0 in 0.252s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.500s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d1186d6d-b75c-4fe0-903d-8ff9b0350d44 tempest-SnapshotsActionsTest-833038338 None] Create snapshot completed successfully
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Deleting offline snapshot 5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] snapshot_file for this snap is: volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f7ea85-5af2-4b1d-a060-9da182fa6e41]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:33 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de
Sep 25 18:38:33 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:34 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1" returned: 0 in 1.814s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_fvkz97_4devstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:38:34 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Converted 112.00 MB image at 61.66 MB/s
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:34 devstack sudo[100143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 1G
Sep 25 18:38:34 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:34 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" returned: 0 in 0.405s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a305c6e2-0f07-4e8c-b3b5-ff2e1be33a8e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:34 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:34 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:34 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 1G" returned: 0 in 0.351s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Downloaded image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 23690f3a-d0e0-4018-935d-aefa7bece0f1 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 for user eeaf367170cf40b2807edbd78ea3c75c is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Marking volume 23690f3a-d0e0-4018-935d-aefa7bece0f1 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Copying metadata from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 to 23690f3a-d0e0-4018-935d-aefa7bece0f1. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Creating volume glance metadata for volume 23690f3a-d0e0-4018-935d-aefa7bece0f1 backed by image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3e1f86-6866-4b9c-9cb1-0460e8f00e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23690f3a-d0e0-4018-935d-aefa7bece0f1', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7d5ac90>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fdaba9-c924-4ada-b898-65c55059d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Volume volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 (23690f3a-d0e0-4018-935d-aefa7bece0f1): created successfully
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fdaba9-c924-4ada-b898-65c55059d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (2574daaa-c2e2-47d9-870e-f27aa4ab638c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:34 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cf6e2764-71f6-485c-a8d5-e24379ccaf8d tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:34 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.374s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:34 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de
Sep 25 18:38:34 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:34 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" returned: 0 in 0.368s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:35 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de
Sep 25 18:38:35 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:35 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" returned: 0 in 0.271s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de" released by "_delete_snapshot" :: held 1.534s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" released by "delete_snapshot" :: held 1.567s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Created reservations ['edaad1ac-c893-4eee-9be7-053d44e1f32a', 'd7636365-e7c9-422b-b686-679b26c3231b', '81b81c77-61ce-441e-b827-f3429a50489f', '83ef6a2f-3172-4557-81c5-98335f240eb2'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Delete snapshot completed successfully.
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ce1413e-adc7-437e-8ad0-a6381a54a5de tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-5bb1e37a-ed7b-4c8d-aca7-82629f2fe9de-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (b2a343f9-96b7-4520-9944-b648b62890eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe36c6-1b3b-42fd-8bd7-a45d33b217fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fe36c6-1b3b-42fd-8bd7-a45d33b217fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-430929021',display_name='tempest-VolumesGetTest-Volume-943974633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7603ad3-0c6f-4b27-989e-1c9af4a30d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:36Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7760a7e5-d6a8-4098-a605-2317d02765e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7760a7e5-d6a8-4098-a605-2317d02765e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c11e2b9-4790-4e7e-8fca-07dfd56fab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c11e2b9-4790-4e7e-8fca-07dfd56fab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7603ad3-0c6f-4b27-989e-1c9af4a30d70', 'volume_name': 'volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c4eda5-f3b7-49ec-b776-3c7b79636757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c4eda5-f3b7-49ec-b776-3c7b79636757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e97bb0e-7a8a-47b0-be05-5c2db6aa27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:35 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Volume a7603ad3-0c6f-4b27-989e-1c9af4a30d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70', 'volume_size': 1}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-430929021',display_name='tempest-VolumesGetTest-Volume-943974633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7603ad3-0c6f-4b27-989e-1c9af4a30d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64652ddac564cf9a5967b5c963787f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:36Z,use_quota=True,user_id='eeaf367170cf40b2807edbd78ea3c75c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Creating volume a7603ad3-0c6f-4b27-989e-1c9af4a30d70 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:35 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:35 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 1073741824
Sep 25 18:38:35 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:36 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 1073741824" returned: 0 in 0.448s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:36 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70
Sep 25 18:38:36 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:36 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.448s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Creating offline snapshot dfc4f4ce-3328-4af0-aac3-9aecb168e562 of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e97bb0e-7a8a-47b0-be05-5c2db6aa27c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b9849-19ae-4f60-9d3b-9b5aa949cea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf124bc-d895-4adf-a18c-4bffc41fb92f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Volume volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 (a7603ad3-0c6f-4b27-989e-1c9af4a30d70): created successfully
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b9849-19ae-4f60-9d3b-9b5aa949cea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Flow 'volume_create_manager' (b2a343f9-96b7-4520-9944-b648b62890eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e66d717f-b976-40de-a91f-650948b1c2b9 tempest-VolumesGetTest-118225911 None] Created volume successfully.
Sep 25 18:38:36 devstack sudo[100174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:36 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:37 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.368s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:37 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 1G
Sep 25 18:38:37 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:37 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 1G" returned: 0 in 0.414s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:37 devstack sudo[100184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562
Sep 25 18:38:37 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:37 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:37 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 is being set with open permissions: ugo+rw
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:37 devstack sudo[100189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562
Sep 25 18:38:37 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-a7603ad3-0c6f-4b27-989e-1c9af4a30d70-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:37 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562" returned: 0 in 0.262s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Lock "cinder-a7603ad3-0c6f-4b27-989e-1c9af4a30d70-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.447s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-be951bf4-fdec-4b6f-ba5d-cbac6b64d61d tempest-SnapshotsActionsTest-833038338 None] Create snapshot completed successfully
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-a7603ad3-0c6f-4b27-989e-1c9af4a30d70" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-a7603ad3-0c6f-4b27-989e-1c9af4a30d70" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6103ad0c-91aa-4057-8ef4-ef5e603c51c9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:38 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70
Sep 25 18:38:38 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-dfc4f4ce-3328-4af0-aac3-9aecb168e562-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-dfc4f4ce-3328-4af0-aac3-9aecb168e562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Acquiring lock "cinder-quobyte-dfc4f4ce-3328-4af0-aac3-9aecb168e562" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-dfc4f4ce-3328-4af0-aac3-9aecb168e562" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Deleting offline snapshot dfc4f4ce-3328-4af0-aac3-9aecb168e562 of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] snapshot_file for this snap is: volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e367d93d-465b-40d0-8d25-97802daa6144]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:38 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70" returned: 0 in 0.394s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:38 devstack sudo[100199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70
Sep 25 18:38:38 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:38 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562
Sep 25 18:38:38 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:38 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7603ad3-0c6f-4b27-989e-1c9af4a30d70" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-a7603ad3-0c6f-4b27-989e-1c9af4a30d70" released by "delete_volume" :: held 0.688s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:38 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562" returned: 0 in 0.371s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b32cd-cd20-411c-a010-47ca9194d676]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Created reservations ['87516fac-ece6-4f5e-b74c-ad5e55a4e1a1', '5f9a7d7a-eb63-43ca-8a7a-36866519c31d', '16ce48f4-48ca-40f9-89d5-73dbf7e511f1', 'ddd90504-d980-4a59-9aee-03443db5492e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:38 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:38 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:38 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:38 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-23690f3a-d0e0-4018-935d-aefa7bece0f1-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:39 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.284s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Lock "cinder-23690f3a-d0e0-4018-935d-aefa7bece0f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:39 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cd15cdf6-a15e-451b-b1ed-ffaf85a0afae tempest-VolumesGetTest-118225911 None] Lock "cinder-a7603ad3-0c6f-4b27-989e-1c9af4a30d70-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.437s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Acquiring lock "cinder-quobyte-23690f3a-d0e0-4018-935d-aefa7bece0f1" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:39 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562
Sep 25 18:38:39 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-23690f3a-d0e0-4018-935d-aefa7bece0f1" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bad967-cfc3-445e-9dc7-34ecdd80b8d7]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:39 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1
Sep 25 18:38:39 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:39 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562" returned: 0 in 0.370s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:39 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562
Sep 25 18:38:39 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:39 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1" returned: 0 in 0.393s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:39 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1
Sep 25 18:38:39 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:39 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.dfc4f4ce-3328-4af0-aac3-9aecb168e562" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-dfc4f4ce-3328-4af0-aac3-9aecb168e562" released by "_delete_snapshot" :: held 1.539s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" released by "delete_snapshot" :: held 1.561s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:39 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-23690f3a-d0e0-4018-935d-aefa7bece0f1" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Created reservations ['4a7abc3f-fb00-454d-9037-206091f6ce70', 'a6f97297-8b39-495d-974a-e86fa2e36b30', 'd8f94f70-4467-465c-8b0d-1a0012a323f5', '78a5dfd4-15a1-4f87-b7af-67526874d450'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Lock "cinder-quobyte-23690f3a-d0e0-4018-935d-aefa7bece0f1" released by "delete_volume" :: held 0.689s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Delete snapshot completed successfully.
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-87336d4f-42b7-4e64-aeb2-22fb9f311eb1 tempest-SnapshotsActionsTest-385154554 None] Lock "cinder-dfc4f4ce-3328-4af0-aac3-9aecb168e562-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Created reservations ['a5558d3d-54c3-439d-9550-b964452b4b92', 'c3920d71-a453-4f4f-b4e4-93733c5a278c', '51ae7ec1-4d7f-47c9-94ce-34a242586757', '5e06d260-5bbc-4df6-9591-15e147984cf0'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:40 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:40 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:40 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Deleted volume successfully.
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7bdc633c-1247-4c81-a2a1-06dda9e9400f tempest-VolumesGetTest-118225911 None] Lock "cinder-23690f3a-d0e0-4018-935d-aefa7bece0f1-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "cinder-ee2d393b-43c2-4723-a5d0-ad7891a9a89e-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-ee2d393b-43c2-4723-a5d0-ad7891a9a89e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "cinder-quobyte-ee2d393b-43c2-4723-a5d0-ad7891a9a89e" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-quobyte-ee2d393b-43c2-4723-a5d0-ad7891a9a89e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Deleting offline snapshot ee2d393b-43c2-4723-a5d0-ad7891a9a89e of volume aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] snapshot_file for this snap is: volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b3a14b-1b34-45c9-a4aa-b12ceb7065b9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:41 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:41 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:41 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:41 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84aaf9c-3255-40f9-8dd2-746d2a60ce63]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:41 devstack sudo[100245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff
Sep 25 18:38:41 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:41 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" returned: 0 in 0.402s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:41 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:41 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:42 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.363s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:42 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e
Sep 25 18:38:42 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:42 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff.ee2d393b-43c2-4723-a5d0-ad7891a9a89e" returned: 0 in 0.258s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-quobyte-ee2d393b-43c2-4723-a5d0-ad7891a9a89e" released by "_delete_snapshot" :: held 1.545s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" released by "delete_snapshot" :: held 1.573s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Created reservations ['47a7bbd6-e4e7-44b1-9193-6badcfb26e9e', '747fce3c-b52e-47fa-9372-b4361839913a', '626d438c-c86a-48cf-8fbf-1bd78ac9e750', '50c4bba9-4581-45ac-94c2-02480c911405'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Delete snapshot completed successfully.
Sep 25 18:38:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5dd45316-06e2-4b7e-ade4-2fb73d63090a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-ee2d393b-43c2-4723-a5d0-ad7891a9a89e-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "cinder-aa6db17f-36db-456f-9af9-2ce3c1dbdcff-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-aa6db17f-36db-456f-9af9-2ce3c1dbdcff-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43185ac-3dee-4091-84c9-da4dcd12827b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:43 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff
Sep 25 18:38:43 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:43 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" returned: 0 in 0.376s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:43 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff
Sep 25 18:38:43 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:43 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-quobyte-aa6db17f-36db-456f-9af9-2ce3c1dbdcff" released by "delete_volume" :: held 0.701s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Created reservations ['f8226783-220f-4522-868c-b123ac53c136', '6cc15f87-03f8-43c2-8e98-2731265829da', 'e9022e26-316e-4e92-af0f-6674d981692d', '0e72a022-bfbe-4024-aa98-121fb6e347f2'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:44 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:44 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:44 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:44 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:44 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.262s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Deleted volume successfully.
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a27b08bc-a01a-4dad-aa9f-6257597e3f0a tempest-SnapshotsActionsTest-833038338 None] Lock "cinder-aa6db17f-36db-456f-9af9-2ce3c1dbdcff-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:44 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.330s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:38:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Flow 'volume_create_manager' (f150b41d-49ca-473d-9b8a-6fcac62a204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182673ea-f2db-4326-bc73-507cca277773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182673ea-f2db-4326-bc73-507cca277773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1312393306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a842ea-dfba-425e-b1d5-2a7ed4127794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42debe32ee4d49fe8bda82d3a662c240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:48Z,use_quota=True,user_id='900ddc56616e45ffa3919484d588d031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bd51f8-8885-4f4f-93b9-d40954f68e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bd51f8-8885-4f4f-93b9-d40954f68e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65ccfa0-b9e2-4794-bfb2-713b8c0a08fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65ccfa0-b9e2-4794-bfb2-713b8c0a08fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a842ea-dfba-425e-b1d5-2a7ed4127794', 'volume_name': 'volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794', 'volume_size': 2}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6d2159-d3ac-4f18-908b-1d915b01b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6d2159-d3ac-4f18-908b-1d915b01b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea4567a-3c9e-4f6b-9fa3-3853b5036549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Volume e0a842ea-dfba-425e-b1d5-2a7ed4127794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794', 'volume_size': 2}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1312393306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a842ea-dfba-425e-b1d5-2a7ed4127794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42debe32ee4d49fe8bda82d3a662c240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:48Z,use_quota=True,user_id='900ddc56616e45ffa3919484d588d031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Creating volume e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:47 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 2147483648 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:47 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 2147483648
Sep 25 18:38:47 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:48 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 2147483648" returned: 0 in 0.530s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:48 devstack sudo[100279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794
Sep 25 18:38:48 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:48 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea4567a-3c9e-4f6b-9fa3-3853b5036549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794', 'volume_size': 2}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c1e0f1-a816-4430-8ec9-94be3bf74466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:48 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Volume volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 (e0a842ea-dfba-425e-b1d5-2a7ed4127794): created successfully
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c1e0f1-a816-4430-8ec9-94be3bf74466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Flow 'volume_create_manager' (f150b41d-49ca-473d-9b8a-6fcac62a204d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1125002a-ac8e-40e7-ab30-89d7dd3379a8 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Created volume successfully.
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Creating offline snapshot 336e5da0-4b58-42d1-b6ce-719493f654cf of volume e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Flow 'volume_create_manager' (e895c98b-440b-4f89-a424-7a1d29211861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01047e5f-8926-4576-8370-ed1be0a19292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a4ed0-29b7-44d7-b6f1-13142894c660]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01047e5f-8926-4576-8370-ed1be0a19292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-423330990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0c25c4-029d-4156-904c-ff50e5a7d1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a7daf521524c218ff5e3b9cbfb6061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:50Z,use_quota=True,user_id='2876060f42da468ca56a0e2d898b4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5488c559-f1eb-4e42-835f-fdf4e80e75f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5488c559-f1eb-4e42-835f-fdf4e80e75f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7310629-89bf-4594-80c1-25b4e9e7ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7310629-89bf-4594-80c1-25b4e9e7ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0c25c4-029d-4156-904c-ff50e5a7d1c5', 'volume_name': 'volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0cee66-2e58-493c-8494-60e7d3bc9e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0cee66-2e58-493c-8494-60e7d3bc9e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1527e4e-4ad2-4586-a394-d807a7159f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:50 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Volume 8b0c25c4-029d-4156-904c-ff50e5a7d1c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5', 'volume_size': 1}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:50 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794
Sep 25 18:38:50 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:50 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794" returned: 0 in 0.378s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf 2G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:50 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf 2G
Sep 25 18:38:50 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:50 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf 2G" returned: 0 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:50 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf
Sep 25 18:38:50 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:51 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf" returned: 0 in 0.280s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf is being set with open permissions: ugo+rw
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:51 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf
Sep 25 18:38:51 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:51 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:51 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info
Sep 25 18:38:51 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:51 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info is being set with open permissions: ugo+rw
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:51 devstack sudo[100305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info
Sep 25 18:38:51 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:51 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.info" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-423330990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0c25c4-029d-4156-904c-ff50e5a7d1c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a7daf521524c218ff5e3b9cbfb6061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:38:50Z,use_quota=True,user_id='2876060f42da468ca56a0e2d898b4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Creating volume 8b0c25c4-029d-4156-904c-ff50e5a7d1c5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:38:52 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:52 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 1073741824
Sep 25 18:38:52 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4d9933cb-ed56-4e8a-9597-a41b5b35850a tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Create snapshot completed successfully
Sep 25 18:38:52 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 1073741824" returned: 0 in 0.414s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:52 devstack sudo[100314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5
Sep 25 18:38:52 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:52 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1527e4e-4ad2-4586-a394-d807a7159f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae81269-1d8f-4094-80ce-79f71fbda875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:38:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Volume volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 (8b0c25c4-029d-4156-904c-ff50e5a7d1c5): created successfully
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae81269-1d8f-4094-80ce-79f71fbda875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:38:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Flow 'volume_create_manager' (e895c98b-440b-4f89-a424-7a1d29211861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:38:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-393a1a89-f55b-4385-89aa-b5520e1e69f8 tempest-VolumesServicesTestJSON-1324020469 None] Created volume successfully.
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "cinder-336e5da0-4b58-42d1-b6ce-719493f654cf-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-336e5da0-4b58-42d1-b6ce-719493f654cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "cinder-quobyte-e0a842ea-dfba-425e-b1d5-2a7ed4127794" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-quobyte-e0a842ea-dfba-425e-b1d5-2a7ed4127794" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "cinder-quobyte-336e5da0-4b58-42d1-b6ce-719493f654cf" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-quobyte-336e5da0-4b58-42d1-b6ce-719493f654cf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Deleting offline snapshot 336e5da0-4b58-42d1-b6ce-719493f654cf of volume e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] snapshot_file for this snap is: volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeb0578-2c7c-43ee-a721-ce731f1d89ab]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Acquiring lock "cinder-8b0c25c4-029d-4156-904c-ff50e5a7d1c5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Lock "cinder-8b0c25c4-029d-4156-904c-ff50e5a7d1c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Acquiring lock "cinder-quobyte-8b0c25c4-029d-4156-904c-ff50e5a7d1c5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:53 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf
Sep 25 18:38:53 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Lock "cinder-quobyte-8b0c25c4-029d-4156-904c-ff50e5a7d1c5" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa806ff5-6526-4797-b293-03990f6b17f3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:53 devstack sudo[100319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5
Sep 25 18:38:53 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:53 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf" returned: 0 in 0.371s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[689494c9-f85f-4357-8f7c-e2f9f2d691f9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:53 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5" returned: 0 in 0.356s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:53 devstack sudo[100324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794
Sep 25 18:38:53 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:53 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5
Sep 25 18:38:53 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:54 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8b0c25c4-029d-4156-904c-ff50e5a7d1c5" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Lock "cinder-quobyte-8b0c25c4-029d-4156-904c-ff50e5a7d1c5" released by "delete_volume" :: held 0.651s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:54 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794" returned: 0 in 0.385s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:54 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf
Sep 25 18:38:54 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Created reservations ['358b24c5-72e0-4ef3-a475-3cd30be4d34d', 'e2246086-f849-4daa-98d4-2fd6182ffa79', 'ba9fa42a-2341-4a8f-b02d-03163dda86b7', '1274ea7f-550b-4603-8d9b-ce3fba546f91'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:54 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:54 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:54 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf" returned: 0 in 0.337s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:54 devstack sudo[100343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf
Sep 25 18:38:54 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:54 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.295s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Deleted volume successfully.
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ce586807-582e-4532-9fd9-dd8140232d15 tempest-VolumesServicesTestJSON-1324020469 None] Lock "cinder-8b0c25c4-029d-4156-904c-ff50e5a7d1c5-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:54 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794.336e5da0-4b58-42d1-b6ce-719493f654cf" returned: 0 in 0.274s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-quobyte-336e5da0-4b58-42d1-b6ce-719493f654cf" released by "_delete_snapshot" :: held 1.485s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-quobyte-e0a842ea-dfba-425e-b1d5-2a7ed4127794" released by "delete_snapshot" :: held 1.507s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Created reservations ['c10fc0e1-1a31-493d-937a-d1cdf8ac6ca8', '4bc818a8-7328-4a50-858e-261e44722a0e', 'dc9cab23-4309-4471-a984-6f5ec5aea023', 'ee5c8018-2af5-49a0-a6eb-d723a4e146eb'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Delete snapshot completed successfully.
Sep 25 18:38:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3f8f76cf-0a20-4bcc-96d6-67fbd6b14aba tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-336e5da0-4b58-42d1-b6ce-719493f654cf-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "cinder-e0a842ea-dfba-425e-b1d5-2a7ed4127794-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-e0a842ea-dfba-425e-b1d5-2a7ed4127794-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "cinder-quobyte-e0a842ea-dfba-425e-b1d5-2a7ed4127794" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-quobyte-e0a842ea-dfba-425e-b1d5-2a7ed4127794" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc2ebc-21a2-4115-9288-24d3c9e8b78f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:55 devstack sudo[100347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794
Sep 25 18:38:55 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:55 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:55 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794
Sep 25 18:38:55 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:56 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e0a842ea-dfba-425e-b1d5-2a7ed4127794" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-quobyte-e0a842ea-dfba-425e-b1d5-2a7ed4127794" released by "delete_volume" :: held 0.707s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Created reservations ['aaac31a2-05f5-4ab9-8ba2-b32a745acf59', '5930de53-1d68-47b9-bbb8-d777c21933ea', '921c2189-e5a2-445b-aebb-9aa066dba3b6', 'aef487ce-62d7-4fc5-9d34-4e95226dc364'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:38:56 devstack sudo[100355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:38:56 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:38:56 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.272s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:38:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Deleted volume successfully.
Sep 25 18:38:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03974b26-0faf-46c3-af59-4d902aefc6a2 tempest-VolumesSnapshotNegativeTestJSON-196000735 None] Lock "cinder-e0a842ea-dfba-425e-b1d5-2a7ed4127794-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:INSERT=57,cinder:UPDATE=168,cinder:SELECT=137,cinder:DELETE=9 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=133,cinder:INSERT=42,cinder:UPDATE=170,cinder:DELETE=19 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Flow 'volume_create_manager' (0ecb74d8-f328-458c-83f4-e7a63f4b66ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6793e786-d357-492f-b47e-492dd6711ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6793e786-d357-492f-b47e-492dd6711ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849487845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613a393b-c8ac-4968-82e0-68fe4aa684dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d88866228544049f88a7c5a6e1d21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:00Z,use_quota=True,user_id='38a28e2d5dcc49edb6fd632398e74fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04192fb-2bd3-4183-9fef-f20bdcdeab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04192fb-2bd3-4183-9fef-f20bdcdeab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e599a0-c2fe-494c-b858-6573cabb8d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e599a0-c2fe-494c-b858-6573cabb8d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613a393b-c8ac-4968-82e0-68fe4aa684dc', 'volume_name': 'volume-613a393b-c8ac-4968-82e0-68fe4aa684dc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6c79f5-1a29-4474-a564-aa8a30cc5c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6c79f5-1a29-4474-a564-aa8a30cc5c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c562455b-c7fb-496f-91ae-abad679ab14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:00 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Volume 613a393b-c8ac-4968-82e0-68fe4aa684dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613a393b-c8ac-4968-82e0-68fe4aa684dc', 'volume_size': 1}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849487845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613a393b-c8ac-4968-82e0-68fe4aa684dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d88866228544049f88a7c5a6e1d21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:00Z,use_quota=True,user_id='38a28e2d5dcc49edb6fd632398e74fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Creating volume 613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:00 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:00 devstack sudo[100359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc 1073741824
Sep 25 18:39:00 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:00 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc 1073741824" returned: 0 in 0.451s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:00 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc
Sep 25 18:39:00 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:01 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c562455b-c7fb-496f-91ae-abad679ab14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613a393b-c8ac-4968-82e0-68fe4aa684dc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89885d3-f7aa-4820-95c2-572bc8b16cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:01 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Volume volume-613a393b-c8ac-4968-82e0-68fe4aa684dc (613a393b-c8ac-4968-82e0-68fe4aa684dc): created successfully
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e89885d3-f7aa-4820-95c2-572bc8b16cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:01 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Flow 'volume_create_manager' (0ecb74d8-f328-458c-83f4-e7a63f4b66ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a129a78e-ea2c-412f-bc11-5d2638588619 tempest-VolumeDependencyTests-1471721064 None] Created volume successfully.
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Creating offline snapshot 8bf76e4c-836d-4c9d-9e0f-3849f013050b of volume 613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f8fcf-6615-464d-ba28-c77ec467159c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:02 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc
Sep 25 18:39:02 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:02 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc" returned: 0 in 0.393s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:02 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b 1G
Sep 25 18:39:02 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:03 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b 1G" returned: 0 in 0.443s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a393b-c8ac-4968-82e0-68fe4aa684dc -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:03 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a393b-c8ac-4968-82e0-68fe4aa684dc -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b
Sep 25 18:39:03 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:03 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a393b-c8ac-4968-82e0-68fe4aa684dc -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b" returned: 0 in 0.310s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:03 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b is being set with open permissions: ugo+rw
Sep 25 18:39:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:03 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b
Sep 25 18:39:03 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:03 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:03 devstack sudo[100392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info
Sep 25 18:39:03 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:04 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:04 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info is being set with open permissions: ugo+rw
Sep 25 18:39:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:04 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info
Sep 25 18:39:04 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:04 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.info" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-93de0a1a-7ed4-4bc2-a586-e75fd141041a tempest-VolumeDependencyTests-1471721064 None] Create snapshot completed successfully
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Flow 'volume_create_manager' (57223912-a83f-4e7a-8437-7d9f5c8833f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257e1c21-c1d3-437a-8ff6-c1f7559d35c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257e1c21-c1d3-437a-8ff6-c1f7559d35c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2049540252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e16244c-3dcf-406f-9b8a-41e29726db00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d88866228544049f88a7c5a6e1d21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8bf76e4c-836d-4c9d-9e0f-3849f013050b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:06Z,use_quota=True,user_id='38a28e2d5dcc49edb6fd632398e74fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8cab218-5488-4323-8eb7-e5bff9552522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8cab218-5488-4323-8eb7-e5bff9552522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d35f6de-b3b9-4a05-aa49-db9295cd2886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d35f6de-b3b9-4a05-aa49-db9295cd2886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e16244c-3dcf-406f-9b8a-41e29726db00', 'volume_name': 'volume-5e16244c-3dcf-406f-9b8a-41e29726db00', 'volume_size': 1, 'snapshot_id': '8bf76e4c-836d-4c9d-9e0f-3849f013050b'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d094ec1-a640-45d1-a1f7-bb7326928ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d094ec1-a640-45d1-a1f7-bb7326928ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefaa838-0cad-44d0-bae4-d2a2eee238dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Volume 5e16244c-3dcf-406f-9b8a-41e29726db00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e16244c-3dcf-406f-9b8a-41e29726db00', 'volume_size': 1, 'snapshot_id': '8bf76e4c-836d-4c9d-9e0f-3849f013050b'}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-quobyte-8bf76e4c-836d-4c9d-9e0f-3849f013050b-5e16244c-3dcf-406f-9b8a-41e29726db00" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-8bf76e4c-836d-4c9d-9e0f-3849f013050b-5e16244c-3dcf-406f-9b8a-41e29726db00" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Creating volume 5e16244c-3dcf-406f-9b8a-41e29726db00 from snapshot 8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-quobyte-5e16244c-3dcf-406f-9b8a-41e29726db00" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-5e16244c-3dcf-406f-9b8a-41e29726db00" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] snapshot: 8bf76e4c-836d-4c9d-9e0f-3849f013050b, volume: 5e16244c-3dcf-406f-9b8a-41e29726db00,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f65cf9c-c34e-4eaa-b184-890a9e6f0a52]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:06 devstack sudo[100398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b
Sep 25 18:39:06 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:06 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b" returned: 0 in 0.368s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613a393b-c8ac-4968-82e0-68fe4aa684dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3292f2dd-018b-49d4-9513-b4d6c3c71e90]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:06 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc
Sep 25 18:39:06 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:07 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:39:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:39:07 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:39:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:07 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00
Sep 25 18:39:07 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:14 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00" returned: 0 in 7.554s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:14 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:39:14 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Converted 1024.00 MB image at 135.53 MB/s
Sep 25 18:39:14 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 is being set with open permissions: ugo+rw
Sep 25 18:39:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:14 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00
Sep 25 18:39:14 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:14 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00" returned: 0 in 0.302s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-5e16244c-3dcf-406f-9b8a-41e29726db00" released by "_copy_volume_from_snapshot" :: held 8.727s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:15 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-8bf76e4c-836d-4c9d-9e0f-3849f013050b-5e16244c-3dcf-406f-9b8a-41e29726db00" released by "_create_volume_from_snapshot" :: held 8.806s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.820s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eefaa838-0cad-44d0-bae4-d2a2eee238dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e16244c-3dcf-406f-9b8a-41e29726db00', 'volume_size': 1, 'snapshot_id': '8bf76e4c-836d-4c9d-9e0f-3849f013050b'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0209b2a9-b483-4eec-b233-8c378cfba21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:15 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Volume volume-5e16244c-3dcf-406f-9b8a-41e29726db00 (5e16244c-3dcf-406f-9b8a-41e29726db00): created successfully
Sep 25 18:39:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0209b2a9-b483-4eec-b233-8c378cfba21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Flow 'volume_create_manager' (57223912-a83f-4e7a-8437-7d9f5c8833f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:15 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7b39457f-8c33-4edf-b14e-32b9fc6ca18c tempest-VolumeDependencyTests-1471721064 None] Created volume successfully.
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-8bf76e4c-836d-4c9d-9e0f-3849f013050b-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-8bf76e4c-836d-4c9d-9e0f-3849f013050b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-quobyte-613a393b-c8ac-4968-82e0-68fe4aa684dc" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-613a393b-c8ac-4968-82e0-68fe4aa684dc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-quobyte-8bf76e4c-836d-4c9d-9e0f-3849f013050b" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-8bf76e4c-836d-4c9d-9e0f-3849f013050b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Deleting offline snapshot 8bf76e4c-836d-4c9d-9e0f-3849f013050b of volume 613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] snapshot_file for this snap is: volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc2ca7-510d-49f5-a9c1-d4fe97463371]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:16 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b
Sep 25 18:39:16 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:16 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b" returned: 0 in 0.388s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613a393b-c8ac-4968-82e0-68fe4aa684dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bb584-0673-443e-8f0d-a0624f17f23e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:16 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc
Sep 25 18:39:16 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:17 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc" returned: 0 in 0.609s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:17 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b
Sep 25 18:39:17 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:17 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b" returned: 0 in 0.349s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:17 devstack sudo[100442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b
Sep 25 18:39:17 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:17 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc.8bf76e4c-836d-4c9d-9e0f-3849f013050b" returned: 0 in 0.252s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-8bf76e4c-836d-4c9d-9e0f-3849f013050b" released by "_delete_snapshot" :: held 1.702s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-613a393b-c8ac-4968-82e0-68fe4aa684dc" released by "delete_snapshot" :: held 1.727s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Created reservations ['4a9cc772-c854-451c-9cd0-9933f0dbd67f', '706e61d7-ae79-4791-b294-de6d974479c0', 'c9cac5f4-3bba-427d-9872-fd266aa55559', 'eb24b2fc-58e6-4fe0-b48c-f03e25296a6e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Delete snapshot completed successfully.
Sep 25 18:39:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0b219f01-63cd-40df-92a2-08a28785aefb tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-8bf76e4c-836d-4c9d-9e0f-3849f013050b-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-613a393b-c8ac-4968-82e0-68fe4aa684dc-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-613a393b-c8ac-4968-82e0-68fe4aa684dc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-quobyte-613a393b-c8ac-4968-82e0-68fe4aa684dc" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-613a393b-c8ac-4968-82e0-68fe4aa684dc" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f1e7b-94ab-483b-b498-5a49f91ca68d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:18 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc
Sep 25 18:39:18 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:18 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:18 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc
Sep 25 18:39:18 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:19 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-613a393b-c8ac-4968-82e0-68fe4aa684dc" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-613a393b-c8ac-4968-82e0-68fe4aa684dc" released by "delete_volume" :: held 0.729s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Created reservations ['0164f86c-2ab4-4c99-8eff-ae1863cc3f59', '0776add8-6876-421b-879e-ff736cb8de83', '7c7b6e17-ea2d-43df-a741-c2d10f7df7e3', '89c27e85-4d0d-4028-b4f9-7e75923222d4'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:19 devstack sudo[100453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:19 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-5e16244c-3dcf-406f-9b8a-41e29726db00-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:19 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.306s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-5e16244c-3dcf-406f-9b8a-41e29726db00-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Deleted volume successfully.
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-020eaf2e-ca74-4429-adca-e1f94501ae28 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-613a393b-c8ac-4968-82e0-68fe4aa684dc-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "cinder-quobyte-5e16244c-3dcf-406f-9b8a-41e29726db00" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-5e16244c-3dcf-406f-9b8a-41e29726db00" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2574e-5962-4523-8bb2-d29c29baa41c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:19 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00
Sep 25 18:39:19 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:20 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:20 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00
Sep 25 18:39:20 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:20 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5e16244c-3dcf-406f-9b8a-41e29726db00" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-quobyte-5e16244c-3dcf-406f-9b8a-41e29726db00" released by "delete_volume" :: held 0.691s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Created reservations ['3c1365ec-c3d8-4e5f-8e35-ce83854eaf6f', 'dd257614-442e-4650-bbbc-0ebb7a80e449', '58c74d8e-a439-4c05-bd0b-6d960f562126', '752085d1-851e-4bda-b829-3805eb7563ad'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:20 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:20 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:20 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.323s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Deleted volume successfully.
Sep 25 18:39:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688ae21a-d58a-4886-a0d2-52f344304eb4 tempest-VolumeDependencyTests-1471721064 None] Lock "cinder-5e16244c-3dcf-406f-9b8a-41e29726db00-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Flow 'volume_create_manager' (8eabb132-c7d9-4011-9dad-c64eed9cdd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7042b17-4204-4ce0-bbbd-e385578d56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7042b17-4204-4ce0-bbbd-e385578d56d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497958173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037db3c2-e41e-4890-ab9c-50f96437b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f4ecf1ac64699aaf3f417d49042ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:25Z,use_quota=True,user_id='6f255283434540fd98f3586683e5a487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a1b322-2830-48f7-9b5e-6e29aab91b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a1b322-2830-48f7-9b5e-6e29aab91b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510969be-5efa-4322-9aac-adb767c75fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510969be-5efa-4322-9aac-adb767c75fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '037db3c2-e41e-4890-ab9c-50f96437b87c', 'volume_name': 'volume-037db3c2-e41e-4890-ab9c-50f96437b87c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677739f-1f5d-430a-bbb0-69fb725aedf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4677739f-1f5d-430a-bbb0-69fb725aedf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90db0e8-2506-4712-b9e5-c0087fd9fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Volume 037db3c2-e41e-4890-ab9c-50f96437b87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-037db3c2-e41e-4890-ab9c-50f96437b87c', 'volume_size': 1}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-497958173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037db3c2-e41e-4890-ab9c-50f96437b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f4ecf1ac64699aaf3f417d49042ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:25Z,use_quota=True,user_id='6f255283434540fd98f3586683e5a487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Creating volume 037db3c2-e41e-4890-ab9c-50f96437b87c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:24 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:24 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c 1073741824
Sep 25 18:39:24 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:25 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c 1073741824" returned: 0 in 0.450s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:25 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c
Sep 25 18:39:25 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:25 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c" returned: 0 in 0.252s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90db0e8-2506-4712-b9e5-c0087fd9fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037db3c2-e41e-4890-ab9c-50f96437b87c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ab3e9d-1d5d-4c02-b89d-14e5b39598b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:25 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Volume volume-037db3c2-e41e-4890-ab9c-50f96437b87c (037db3c2-e41e-4890-ab9c-50f96437b87c): created successfully
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ab3e9d-1d5d-4c02-b89d-14e5b39598b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Flow 'volume_create_manager' (8eabb132-c7d9-4011-9dad-c64eed9cdd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0415a946-03f8-435d-b6d8-0f8ec52e7bb6 tempest-ProjectReaderTests-819029866 None] Created volume successfully.
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Acquiring lock "cinder-037db3c2-e41e-4890-ab9c-50f96437b87c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Lock "cinder-037db3c2-e41e-4890-ab9c-50f96437b87c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Acquiring lock "cinder-quobyte-037db3c2-e41e-4890-ab9c-50f96437b87c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Lock "cinder-quobyte-037db3c2-e41e-4890-ab9c-50f96437b87c" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30df67-f70f-48e9-ad8b-fa778e888e0e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:26 devstack sudo[100478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c
Sep 25 18:39:26 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:26 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c" returned: 0 in 0.442s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:26 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c
Sep 25 18:39:26 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:26 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-037db3c2-e41e-4890-ab9c-50f96437b87c" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Lock "cinder-quobyte-037db3c2-e41e-4890-ab9c-50f96437b87c" released by "delete_volume" :: held 0.758s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Created reservations ['4d899cdd-76d7-4832-a3a0-b3a5a24dedb7', '699fe02c-8ac5-4f69-8467-bb4529b8d5c0', '35bed673-9757-4cfa-ae4a-04ef696c2357', '161d46bd-9d21-4e48-8434-677db2b43edd'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:26 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:26 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:27 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Deleted volume successfully.
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed1d8e0d-08fc-485f-800e-1ba6dc772beb tempest-ProjectReaderTests-819029866 None] Lock "cinder-037db3c2-e41e-4890-ab9c-50f96437b87c-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Flow 'volume_create_manager' (a55773bd-0992-4ad0-beb7-9d8611eef380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d89b4-f5ff-4d9e-af28-46a826bca74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d89b4-f5ff-4d9e-af28-46a826bca74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686570330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a1c5c6-097a-4cb6-bfe0-26aee340b69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f4ecf1ac64699aaf3f417d49042ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:27Z,use_quota=True,user_id='6f255283434540fd98f3586683e5a487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11185453-9e8c-4e2a-b5b3-e9c3d1659fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11185453-9e8c-4e2a-b5b3-e9c3d1659fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bb93cb-3265-406c-bb91-22ec95d0ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bb93cb-3265-406c-bb91-22ec95d0ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a1c5c6-097a-4cb6-bfe0-26aee340b69a', 'volume_name': 'volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163e4ad9-7163-4a93-8a23-5588565706c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163e4ad9-7163-4a93-8a23-5588565706c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98296fc1-d0e4-4671-bf66-ca77f5ce71b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:27 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Volume f9a1c5c6-097a-4cb6-bfe0-26aee340b69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a', 'volume_size': 1}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-686570330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a1c5c6-097a-4cb6-bfe0-26aee340b69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a0f4ecf1ac64699aaf3f417d49042ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:27Z,use_quota=True,user_id='6f255283434540fd98f3586683e5a487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Creating volume f9a1c5c6-097a-4cb6-bfe0-26aee340b69a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:27 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:27 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a 1073741824
Sep 25 18:39:27 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:28 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a 1073741824" returned: 0 in 0.447s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:28 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a
Sep 25 18:39:28 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:28 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a" returned: 0 in 0.259s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98296fc1-d0e4-4671-bf66-ca77f5ce71b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63722ac-a006-4258-8324-6407b40029d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:28 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Volume volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a (f9a1c5c6-097a-4cb6-bfe0-26aee340b69a): created successfully
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63722ac-a006-4258-8324-6407b40029d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Flow 'volume_create_manager' (a55773bd-0992-4ad0-beb7-9d8611eef380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9948e88-ebc5-463c-af18-627fd0b56146 tempest-ProjectReaderTests-819029866 None] Created volume successfully.
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Acquiring lock "cinder-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Lock "cinder-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Acquiring lock "cinder-quobyte-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Lock "cinder-quobyte-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb07bb-1865-4933-8253-2a216405e8b0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:28 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a
Sep 25 18:39:28 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:29 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:29 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a
Sep 25 18:39:29 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:29 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Lock "cinder-quobyte-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a" released by "delete_volume" :: held 0.698s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Created reservations ['b98efe7c-880a-491b-af18-1f23dea88125', '5e27b326-fc11-4b24-ad99-45214d192819', '7ecadd66-2a5c-45e1-90e6-94f1c3b81564', '97504db6-c194-4fc5-8ed9-453bf7f8979c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:29 devstack sudo[100519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:29 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:29 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Deleted volume successfully.
Sep 25 18:39:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6ed2d9bf-b88b-432c-96cc-80bfecee10c2 tempest-ProjectReaderTests-819029866 None] Lock "cinder-f9a1c5c6-097a-4cb6-bfe0-26aee340b69a-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (b2baafc7-741d-49e6-9b53-7edd40bd28d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad32e48f-5637-4de3-9900-a98c32dc12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad32e48f-5637-4de3-9900-a98c32dc12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719140328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a743c32-b676-4b77-b208-750cd41c438b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:37Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7cf70e-1cb7-47b3-9b37-98568d7bb825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7cf70e-1cb7-47b3-9b37-98568d7bb825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d310ae-673e-4e43-b0b4-e91621501498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d310ae-673e-4e43-b0b4-e91621501498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a743c32-b676-4b77-b208-750cd41c438b', 'volume_name': 'volume-4a743c32-b676-4b77-b208-750cd41c438b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee133636-da5e-4445-9f1f-f64cd1edf027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee133636-da5e-4445-9f1f-f64cd1edf027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5094d75-4005-4b73-8d57-18a7767affb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:37 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Volume 4a743c32-b676-4b77-b208-750cd41c438b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a743c32-b676-4b77-b208-750cd41c438b', 'volume_size': 1}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719140328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a743c32-b676-4b77-b208-750cd41c438b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:37Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Creating volume 4a743c32-b676-4b77-b208-750cd41c438b {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:37 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:37 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b 1073741824
Sep 25 18:39:37 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:37 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b 1073741824" returned: 0 in 0.485s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:37 devstack sudo[100655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b
Sep 25 18:39:37 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:37 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5094d75-4005-4b73-8d57-18a7767affb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a743c32-b676-4b77-b208-750cd41c438b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6386502b-24e6-4a7e-bf33-c7371e6c2a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Volume volume-4a743c32-b676-4b77-b208-750cd41c438b (4a743c32-b676-4b77-b208-750cd41c438b): created successfully
Sep 25 18:39:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6386502b-24e6-4a7e-bf33-c7371e6c2a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (b2baafc7-741d-49e6-9b53-7edd40bd28d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-dfbe581d-f665-4564-b554-d6f599814a68 tempest-VolumesActionsTest-1533874921 None] Created volume successfully.
Sep 25 18:39:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff2f6eac-f68a-4e3e-a3e8-8122310dfcbc tempest-VolumesActionsTest-1533874921 None] Acquiring lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b" by "attach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff2f6eac-f68a-4e3e-a3e8-8122310dfcbc tempest-VolumesActionsTest-1533874921 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b" acquired by "attach_volume" :: waited 0.028s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ff2f6eac-f68a-4e3e-a3e8-8122310dfcbc tempest-VolumesActionsTest-1533874921 None] Attaching volume 4a743c32-b676-4b77-b208-750cd41c438b to instance 1321f277-81b1-44b3-a82c-5156cab7a34c at mountpoint /dev/vdb on host None.
Sep 25 18:39:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ff2f6eac-f68a-4e3e-a3e8-8122310dfcbc tempest-VolumesActionsTest-1533874921 None] Attach volume completed successfully.
Sep 25 18:39:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff2f6eac-f68a-4e3e-a3e8-8122310dfcbc tempest-VolumesActionsTest-1533874921 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b" released by "attach_volume" :: held 0.121s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2373aea5-9dab-4173-8acc-794b5ecf1df0 tempest-VolumesActionsTest-1772861603 None] Terminate volume connection completed successfully.
Sep 25 18:39:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2373aea5-9dab-4173-8acc-794b5ecf1df0 tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-detach_volume" by "detach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2373aea5-9dab-4173-8acc-794b5ecf1df0 tempest-VolumesActionsTest-1772861603 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2373aea5-9dab-4173-8acc-794b5ecf1df0 tempest-VolumesActionsTest-1772861603 None] Detaching volume 4a743c32-b676-4b77-b208-750cd41c438b from instance 1321f277-81b1-44b3-a82c-5156cab7a34c.
Sep 25 18:39:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2373aea5-9dab-4173-8acc-794b5ecf1df0 tempest-VolumesActionsTest-1772861603 None] Detach volume completed successfully.
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2373aea5-9dab-4173-8acc-794b5ecf1df0 tempest-VolumesActionsTest-1772861603 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3426949-96df-4067-8ff3-4b28b19d39b2 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-detach_volume" by "detach_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3426949-96df-4067-8ff3-4b28b19d39b2 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e3426949-96df-4067-8ff3-4b28b19d39b2 tempest-VolumesActionsTest-1533874921 None] Volume detach called, but volume not attached.
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3426949-96df-4067-8ff3-4b28b19d39b2 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "cinder-quobyte-4a743c32-b676-4b77-b208-750cd41c438b" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-quobyte-4a743c32-b676-4b77-b208-750cd41c438b" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d4306-d10f-4b74-8322-1c1ed76ce4e9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:40 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b
Sep 25 18:39:40 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:41 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:41 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b
Sep 25 18:39:41 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:41 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4a743c32-b676-4b77-b208-750cd41c438b" returned: 0 in 0.271s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-quobyte-4a743c32-b676-4b77-b208-750cd41c438b" released by "delete_volume" :: held 0.716s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Created reservations ['d2958dc3-01e6-43c5-bdb4-0220c051fa83', '5848c13f-5c52-4967-9d1c-f76a28708614', '2dd7b677-ce3d-43f4-94cd-114cb37ddb10', '797bb4bb-8f5e-4daa-86dc-f4121967a0cc'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:41 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:41 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:41 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.360s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Deleted volume successfully.
Sep 25 18:39:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac697218-3899-4803-b4e5-3ff826d8e452 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-4a743c32-b676-4b77-b208-750cd41c438b-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:44 devstack sudo[100704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:44 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:44 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (7d0f7500-309f-476f-93d0-1fe4a3728ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d358ad3c-283e-43df-ad3a-733a037995bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d358ad3c-283e-43df-ad3a-733a037995bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1392281075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e068163-1b57-44fa-b713-d4d21508a1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:45Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a8e331-9ca3-4a30-9a25-25d90be80ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a8e331-9ca3-4a30-9a25-25d90be80ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9e24a3-c981-4d92-bfa1-f3fce9a2bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9e24a3-c981-4d92-bfa1-f3fce9a2bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e068163-1b57-44fa-b713-d4d21508a1dc', 'volume_name': 'volume-9e068163-1b57-44fa-b713-d4d21508a1dc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d97f76-f5ff-4590-b01d-dd3ff07c18aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d97f76-f5ff-4590-b01d-dd3ff07c18aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd6f2fb-7335-4b66-a36b-1160b6b4dc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Volume 9e068163-1b57-44fa-b713-d4d21508a1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e068163-1b57-44fa-b713-d4d21508a1dc', 'volume_size': 1}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1392281075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e068163-1b57-44fa-b713-d4d21508a1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:45Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Creating volume 9e068163-1b57-44fa-b713-d4d21508a1dc {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:45 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:45 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc 1073741824
Sep 25 18:39:45 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:45 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc 1073741824" returned: 0 in 0.399s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:45 devstack sudo[100712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc
Sep 25 18:39:45 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:45 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd6f2fb-7335-4b66-a36b-1160b6b4dc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e068163-1b57-44fa-b713-d4d21508a1dc', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871f1248-0cd3-44a1-8ed8-e2c9314e31d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Volume volume-9e068163-1b57-44fa-b713-d4d21508a1dc (9e068163-1b57-44fa-b713-d4d21508a1dc): created successfully
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871f1248-0cd3-44a1-8ed8-e2c9314e31d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (7d0f7500-309f-476f-93d0-1fe4a3728ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:45 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-63811b89-5594-4b68-a714-7295921d53df tempest-VolumesActionsTest-1533874921 None] Created volume successfully.
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-9e068163-1b57-44fa-b713-d4d21508a1dc-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Lock "cinder-9e068163-1b57-44fa-b713-d4d21508a1dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-quobyte-9e068163-1b57-44fa-b713-d4d21508a1dc" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-9e068163-1b57-44fa-b713-d4d21508a1dc" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a10a274-ad9d-4f2c-9307-570b21b04bae]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:46 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc
Sep 25 18:39:46 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:46 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:46 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc
Sep 25 18:39:46 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:46 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9e068163-1b57-44fa-b713-d4d21508a1dc" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-9e068163-1b57-44fa-b713-d4d21508a1dc" released by "delete_volume" :: held 0.629s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Created reservations ['9492b45a-1579-470c-be59-1ca61a590aff', 'ca710845-45f4-4e12-9b90-f3f7cc9a95ba', 'be0b35b3-9966-4c8d-9ae8-973e78756be4', 'd528147a-7c88-40f5-9439-9c0d9650b519'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:46 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:46 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:47 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Deleted volume successfully.
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ed60a716-3414-4e39-84d2-c8c6efb908ce tempest-VolumesActionsTest-1772861603 None] Lock "cinder-9e068163-1b57-44fa-b713-d4d21508a1dc-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (983d41c7-c82b-4c63-8f68-905fcd64aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139c2da4-ae93-4135-a5ae-90e1a12c8506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139c2da4-ae93-4135-a5ae-90e1a12c8506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1432949693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8586744-4c69-429f-b168-1e1b6c04aaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:48Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b9a850-fd80-43e6-a7ca-ccafa5f0f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b9a850-fd80-43e6-a7ca-ccafa5f0f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10aac90b-a5f9-4ab7-a612-1c22a0926f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10aac90b-a5f9-4ab7-a612-1c22a0926f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8586744-4c69-429f-b168-1e1b6c04aaac', 'volume_name': 'volume-c8586744-4c69-429f-b168-1e1b6c04aaac', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534fc54c-ff02-40b2-9b7c-dfcef2772e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534fc54c-ff02-40b2-9b7c-dfcef2772e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd575ef-eb96-4aff-8f6a-359f75725b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Volume c8586744-4c69-429f-b168-1e1b6c04aaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8586744-4c69-429f-b168-1e1b6c04aaac', 'volume_size': 1}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1432949693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8586744-4c69-429f-b168-1e1b6c04aaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:48Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Creating volume c8586744-4c69-429f-b168-1e1b6c04aaac {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:47 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:47 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac 1073741824
Sep 25 18:39:47 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:48 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac 1073741824" returned: 0 in 0.423s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:48 devstack sudo[100732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac
Sep 25 18:39:48 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:48 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd575ef-eb96-4aff-8f6a-359f75725b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8586744-4c69-429f-b168-1e1b6c04aaac', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f63fc5a-8708-441e-8322-7a2dc4406595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:48 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Volume volume-c8586744-4c69-429f-b168-1e1b6c04aaac (c8586744-4c69-429f-b168-1e1b6c04aaac): created successfully
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f63fc5a-8708-441e-8322-7a2dc4406595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (983d41c7-c82b-4c63-8f68-905fcd64aacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-77762040-a6f8-499d-9e21-a6539b9452ed tempest-VolumesActionsTest-1533874921 None] Created volume successfully.
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-c8586744-4c69-429f-b168-1e1b6c04aaac-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Lock "cinder-c8586744-4c69-429f-b168-1e1b6c04aaac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-quobyte-c8586744-4c69-429f-b168-1e1b6c04aaac" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-c8586744-4c69-429f-b168-1e1b6c04aaac" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce8d6fc-4d0e-4edf-9a00-977742dfc21b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:49 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac
Sep 25 18:39:49 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:49 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac" returned: 0 in 0.367s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:49 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac
Sep 25 18:39:49 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:49 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c8586744-4c69-429f-b168-1e1b6c04aaac" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-c8586744-4c69-429f-b168-1e1b6c04aaac" released by "delete_volume" :: held 0.646s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Created reservations ['481cabfb-2e23-4b7d-aec9-f99c908bdc89', '95fc4e9f-d2a1-4969-9f17-cd8086a11c29', '31aad1f2-7faf-4a64-b684-7ca08d1df6f3', '3632df3f-000c-49f1-8d51-ec3a6d8ebb57'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:49 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:49 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:49 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Deleted volume successfully.
Sep 25 18:39:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cb52ef93-fe3f-45db-ad4b-61e5fe86d881 tempest-VolumesActionsTest-1772861603 None] Lock "cinder-c8586744-4c69-429f-b168-1e1b6c04aaac-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (9696c4df-8eae-4158-b1b7-7ba8a58229f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea1ddd2-57a5-4933-a3a1-3d9ebc128c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea1ddd2-57a5-4933-a3a1-3d9ebc128c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105430441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e43e702-acad-4f4f-847d-14f76243446d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:50Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da69281-c5ac-4e9d-9bb1-2f1b22069446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da69281-c5ac-4e9d-9bb1-2f1b22069446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b84f63-bb7d-4e07-a9d9-854485546ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b84f63-bb7d-4e07-a9d9-854485546ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e43e702-acad-4f4f-847d-14f76243446d', 'volume_name': 'volume-7e43e702-acad-4f4f-847d-14f76243446d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88f3887-87f1-4d4c-af7d-c7ba11f4f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88f3887-87f1-4d4c-af7d-c7ba11f4f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7f7e63-db68-49d0-b8ad-e7310028ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:50 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Volume 7e43e702-acad-4f4f-847d-14f76243446d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e43e702-acad-4f4f-847d-14f76243446d', 'volume_size': 1}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105430441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e43e702-acad-4f4f-847d-14f76243446d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:50Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Creating volume 7e43e702-acad-4f4f-847d-14f76243446d {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:50 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:50 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d 1073741824
Sep 25 18:39:50 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:50 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d 1073741824" returned: 0 in 0.399s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:51 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d
Sep 25 18:39:51 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:51 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7f7e63-db68-49d0-b8ad-e7310028ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e43e702-acad-4f4f-847d-14f76243446d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f0bc2a-cc9b-4ca3-858c-6d8e83f3f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:51 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Volume volume-7e43e702-acad-4f4f-847d-14f76243446d (7e43e702-acad-4f4f-847d-14f76243446d): created successfully
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f0bc2a-cc9b-4ca3-858c-6d8e83f3f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (9696c4df-8eae-4158-b1b7-7ba8a58229f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:51 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-255c4898-0382-4854-a354-214b3a95b937 tempest-VolumesActionsTest-1533874921 None] Created volume successfully.
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-7e43e702-acad-4f4f-847d-14f76243446d-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Lock "cinder-7e43e702-acad-4f4f-847d-14f76243446d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-quobyte-7e43e702-acad-4f4f-847d-14f76243446d" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-7e43e702-acad-4f4f-847d-14f76243446d" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c686665-43b2-4ba7-91d7-b98083fb36ab]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:51 devstack sudo[100757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d
Sep 25 18:39:51 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:52 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d" returned: 0 in 0.352s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:52 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d
Sep 25 18:39:52 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:52 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7e43e702-acad-4f4f-847d-14f76243446d" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-7e43e702-acad-4f4f-847d-14f76243446d" released by "delete_volume" :: held 0.633s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Created reservations ['86e8ece1-a02a-449c-a6aa-09e35918f2f1', 'd575450f-be3e-4ea4-85b7-d7ae680a4b9b', '4ee1d925-e644-4ff3-a6b5-5757511cd35d', '3d60a500-110b-4462-848a-9884c88a5e4b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:52 devstack sudo[100765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:52 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:52 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Deleted volume successfully.
Sep 25 18:39:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-33571291-98cd-4544-b202-24e8d416d5ed tempest-VolumesActionsTest-1772861603 None] Lock "cinder-7e43e702-acad-4f4f-847d-14f76243446d-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (6ad78b39-5708-4095-84c3-c7f22a6c4072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9811c8-1140-4d02-8d05-67f9af22318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9811c8-1140-4d02-8d05-67f9af22318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131130044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec0cf9f-e733-4aa9-b611-be878ffc5efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:53Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45dd56f-a05e-4e91-86b7-4e9a87ba76c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45dd56f-a05e-4e91-86b7-4e9a87ba76c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86a34a2-01ad-4000-b843-185b92328a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86a34a2-01ad-4000-b843-185b92328a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec0cf9f-e733-4aa9-b611-be878ffc5efd', 'volume_name': 'volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a507c319-dd69-4109-a7de-09d8a1f052d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a507c319-dd69-4109-a7de-09d8a1f052d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20209b65-5ad1-4b1a-aa94-fb0906ce16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Volume 8ec0cf9f-e733-4aa9-b611-be878ffc5efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd', 'volume_size': 1}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-131130044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec0cf9f-e733-4aa9-b611-be878ffc5efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:53Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Creating volume 8ec0cf9f-e733-4aa9-b611-be878ffc5efd {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:53 devstack sudo[100768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd 1073741824
Sep 25 18:39:53 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:53 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd 1073741824" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:53 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd
Sep 25 18:39:53 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:54 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20209b65-5ad1-4b1a-aa94-fb0906ce16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584f2bac-b018-4514-bd66-140038e41b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Volume volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd (8ec0cf9f-e733-4aa9-b611-be878ffc5efd): created successfully
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584f2bac-b018-4514-bd66-140038e41b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (6ad78b39-5708-4095-84c3-c7f22a6c4072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d95314f6-0dfd-4dd8-9042-2fc71f6f2328 tempest-VolumesActionsTest-1533874921 None] Created volume successfully.
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-8ec0cf9f-e733-4aa9-b611-be878ffc5efd-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Lock "cinder-8ec0cf9f-e733-4aa9-b611-be878ffc5efd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Acquiring lock "cinder-quobyte-8ec0cf9f-e733-4aa9-b611-be878ffc5efd" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-8ec0cf9f-e733-4aa9-b611-be878ffc5efd" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f58bff4-b19f-469c-baee-5e21adf20e9c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:54 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd
Sep 25 18:39:54 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:54 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd" returned: 0 in 0.347s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:54 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd
Sep 25 18:39:54 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:55 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8ec0cf9f-e733-4aa9-b611-be878ffc5efd" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Lock "cinder-quobyte-8ec0cf9f-e733-4aa9-b611-be878ffc5efd" released by "delete_volume" :: held 0.633s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Created reservations ['283e7f6d-476e-46b0-b217-6049d7f4dd66', '5517ef1c-3b33-4b9e-8c8c-3a8068694ea5', 'f5a1c2f3-d608-42e8-8183-33b313c6ca34', '8b2c6f4c-f46e-4879-83bf-1b559e800881'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:55 devstack sudo[100784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:55 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:55 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.238s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Deleted volume successfully.
Sep 25 18:39:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-678cbe91-7bc2-42e6-9f20-67531a2d1b7e tempest-VolumesActionsTest-1772861603 None] Lock "cinder-8ec0cf9f-e733-4aa9-b611-be878ffc5efd-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (92bb6af1-6598-4ac4-90de-dbffa8fedbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6031e4e3-5186-4b10-9ab1-a13174d18532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6031e4e3-5186-4b10-9ab1-a13174d18532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279031928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:56Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2f2589-61ed-441f-b65a-079e90765ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2f2589-61ed-441f-b65a-079e90765ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9515b24c-275d-4a56-9ed0-fd9a33a3fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9515b24c-275d-4a56-9ed0-fd9a33a3fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34', 'volume_name': 'volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8715c40-e73b-4c80-863c-e28f31b29df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8715c40-e73b-4c80-863c-e28f31b29df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9521b48b-bbbe-4d1f-bca8-375a1f2035f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:56 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Volume 98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34', 'volume_size': 1}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279031928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bed2f6473a747988b5a636df69e2653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:39:56Z,use_quota=True,user_id='c55e1cdc87fa4fb0b6986f7e432e097a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Creating volume 98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:39:56 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:56 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 1073741824
Sep 25 18:39:56 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:56 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 1073741824" returned: 0 in 0.403s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:56 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34
Sep 25 18:39:56 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:56 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34" returned: 0 in 0.234s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9521b48b-bbbe-4d1f-bca8-375a1f2035f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236de6ca-92f5-4720-88a8-7801353cc7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:39:56 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Volume volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 (98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34): created successfully
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236de6ca-92f5-4720-88a8-7801353cc7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:39:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Flow 'volume_create_manager' (92bb6af1-6598-4ac4-90de-dbffa8fedbed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:39:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d0708bcb-c560-4909-96b2-2f4cfd4a1a8f tempest-VolumesActionsTest-1533874921 None] Created volume successfully.
Sep 25 18:39:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "cinder-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "cinder-quobyte-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:39:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-quobyte-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:39:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260ace6-240e-4b75-9519-22c39bdb87aa]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:39:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:58 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34
Sep 25 18:39:58 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:59 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34" returned: 0 in 0.354s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:59 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34
Sep 25 18:39:59 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:59 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34" returned: 0 in 0.254s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-quobyte-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34" released by "delete_volume" :: held 0.647s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Created reservations ['7f64a0f5-0619-4f37-a98a-26442d60ddb5', 'cbf60ad2-db79-49f7-b16e-5f16a7513cee', 'f5387a6f-76d6-462c-8328-4c242f079d56', '6b066961-23d4-4299-a07f-8bb3fe690d86'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:39:59 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:39:59 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:39:59 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.238s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:39:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Deleted volume successfully.
Sep 25 18:39:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca2fd17e-2f14-4e42-bb58-e6f4b764f400 tempest-VolumesActionsTest-1533874921 None] Lock "cinder-98eb4aa2-6bf3-4b9e-9a5d-0e455b7cdc34-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:09 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=93,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=8 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:40:09 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=118,cinder:SELECT=83,cinder:DELETE=13,cinder:INSERT=24 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Flow 'volume_create_manager' (62805fcb-c759-4d34-8c18-8b2c33067608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ce794d-8ba5-4cf1-8344-bd323959a544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ce794d-8ba5-4cf1-8344-bd323959a544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-785623043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedfdf99-9f81-46ac-bc97-3f0027bd109f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c251622f840648a6b41e9507cb670987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:14Z,use_quota=True,user_id='3eff94728df047f99b22d735e23fd8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83532104-6c62-4d59-b515-086d0b2a5a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83532104-6c62-4d59-b515-086d0b2a5a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e688f797-c645-4725-9287-24471df64202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e688f797-c645-4725-9287-24471df64202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fedfdf99-9f81-46ac-bc97-3f0027bd109f', 'volume_name': 'volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7f02330>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc264d47-db1d-43ae-a060-0269f37c6602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc264d47-db1d-43ae-a060-0269f37c6602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7c48ef-0f91-4f6d-a0c0-e65939454608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:14 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Volume fedfdf99-9f81-46ac-bc97-3f0027bd109f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7f02330>}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Trying to clone fedfdf99-9f81-46ac-bc97-3f0027bd109f from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:40:14 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2add1e3-79c3-4c44-95f2-eb517bb4f868]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:15 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD
Sep 25 18:40:15 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:15 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 is fetched for user 3eff94728df047f99b22d735e23fd8af. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b3e0e-3968-42e1-9fc3-c7a13698caf3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:15 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD
Sep 25 18:40:15 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:15 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-785623043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedfdf99-9f81-46ac-bc97-3f0027bd109f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c251622f840648a6b41e9507cb670987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:14Z,use_quota=True,user_id='3eff94728df047f99b22d735e23fd8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Creating volume fedfdf99-9f81-46ac-bc97-3f0027bd109f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:40:15 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:40:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:15 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f 1073741824
Sep 25 18:40:15 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:16 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f 1073741824" returned: 0 in 0.399s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:16 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f
Sep 25 18:40:16 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:16 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f" returned: 0 in 0.254s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Attempting download of 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume fedfdf99-9f81-46ac-bc97-3f0027bd109f. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[195045b3-9676-454b-abf8-7fcf4ede5bfd]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:16 devstack sudo[100839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9
Sep 25 18:40:16 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:16 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9" returned: 0 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:16 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9
Sep 25 18:40:16 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:17 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9" returned: 1 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_rkp3udv9' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb4214-abdb-4d61-9b10-fbfaca8d84bc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:17 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD
Sep 25 18:40:17 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:17 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 was qcow2, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:40:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:17 devstack sudo[100852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f
Sep 25 18:40:17 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:19 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f" returned: 0 in 1.612s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_heyitaubdevstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:40:19 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Converted 112.00 MB image at 69.42 MB/s
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:19 devstack sudo[100861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f 1G
Sep 25 18:40:19 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:19 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f 1G" returned: 0 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Downloaded image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume fedfdf99-9f81-46ac-bc97-3f0027bd109f successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 for user 3eff94728df047f99b22d735e23fd8af is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Marking volume fedfdf99-9f81-46ac-bc97-3f0027bd109f as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Copying metadata from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 to fedfdf99-9f81-46ac-bc97-3f0027bd109f. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Creating volume glance metadata for volume fedfdf99-9f81-46ac-bc97-3f0027bd109f backed by image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7c48ef-0f91-4f6d-a0c0-e65939454608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7f02330>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1b2562-973a-4621-945d-cb140cba2f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:19 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Volume volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f (fedfdf99-9f81-46ac-bc97-3f0027bd109f): created successfully
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1b2562-973a-4621-945d-cb140cba2f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Flow 'volume_create_manager' (62805fcb-c759-4d34-8c18-8b2c33067608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-67477e59-e676-4219-9c4e-e2589a13f73e tempest-VolumesImageMetadata-230590175 None] Created volume successfully.
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Acquiring lock "cinder-fedfdf99-9f81-46ac-bc97-3f0027bd109f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Lock "cinder-fedfdf99-9f81-46ac-bc97-3f0027bd109f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Acquiring lock "cinder-quobyte-fedfdf99-9f81-46ac-bc97-3f0027bd109f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Lock "cinder-quobyte-fedfdf99-9f81-46ac-bc97-3f0027bd109f" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35b5c0-eb35-4566-8b27-982d933f838d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:21 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f
Sep 25 18:40:21 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:21 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:21 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f
Sep 25 18:40:21 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:21 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fedfdf99-9f81-46ac-bc97-3f0027bd109f" returned: 0 in 0.237s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Lock "cinder-quobyte-fedfdf99-9f81-46ac-bc97-3f0027bd109f" released by "delete_volume" :: held 0.626s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Created reservations ['7e75ecdf-e30a-4795-9232-e86bae2586ed', 'f08b4f3f-a171-4edb-a3c9-6f807ef0a5eb', '659c0550-c56d-4f55-b318-885c01eddfc3', '36a0d37b-f1b3-4f33-85b2-6e6362889c20'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:21 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:21 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:22 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:22 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Deleted volume successfully.
Sep 25 18:40:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e8063dcb-e37a-4a2b-b4ac-e23e6dc191d2 tempest-VolumesImageMetadata-230590175 None] Lock "cinder-fedfdf99-9f81-46ac-bc97-3f0027bd109f-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Flow 'volume_create_manager' (0f4a5ead-62be-48ea-ac44-c7f8b16b4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0185598-598b-437c-9f33-56cf2b269cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0185598-598b-437c-9f33-56cf2b269cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-686762406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f125b77-e76e-4995-a705-5130440a09e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba33350a12d4010a55555acc77b15a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:27Z,use_quota=True,user_id='5c7ec3a34aa64f739de138b6db403624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb4fb69-9f69-45f5-a987-76b00c3a4615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb4fb69-9f69-45f5-a987-76b00c3a4615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38e6338-feca-4273-945a-56e91fb799af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38e6338-feca-4273-945a-56e91fb799af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f125b77-e76e-4995-a705-5130440a09e7', 'volume_name': 'volume-4f125b77-e76e-4995-a705-5130440a09e7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda3611e-9427-42c1-8b5c-8836e2762451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda3611e-9427-42c1-8b5c-8836e2762451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb89975-378c-499d-a3b0-cc1411a3c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Volume 4f125b77-e76e-4995-a705-5130440a09e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f125b77-e76e-4995-a705-5130440a09e7', 'volume_size': 1}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-686762406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f125b77-e76e-4995-a705-5130440a09e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba33350a12d4010a55555acc77b15a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:27Z,use_quota=True,user_id='5c7ec3a34aa64f739de138b6db403624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Creating volume 4f125b77-e76e-4995-a705-5130440a09e7 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:40:26 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:40:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:26 devstack sudo[100880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7 1073741824
Sep 25 18:40:26 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:27 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7 1073741824" returned: 0 in 0.398s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:27 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7
Sep 25 18:40:27 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:27 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb89975-378c-499d-a3b0-cc1411a3c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f125b77-e76e-4995-a705-5130440a09e7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c4c750-43c1-4167-a6b3-63ac6062a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:27 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Volume volume-4f125b77-e76e-4995-a705-5130440a09e7 (4f125b77-e76e-4995-a705-5130440a09e7): created successfully
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c4c750-43c1-4167-a6b3-63ac6062a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Flow 'volume_create_manager' (0f4a5ead-62be-48ea-ac44-c7f8b16b4a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9d26e845-2dcf-4426-a964-99990ebd42e6 tempest-VolumesTransfersV357Test-1929127128 None] Created volume successfully.
Sep 25 18:40:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-31ebca4a-15ad-4dcb-8299-2f4b5374fba2 tempest-VolumesTransfersV357Test-1966850808 None] Transfer volume completed successfully.
Sep 25 18:40:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Acquiring lock "cinder-4f125b77-e76e-4995-a705-5130440a09e7-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-4f125b77-e76e-4995-a705-5130440a09e7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Acquiring lock "cinder-quobyte-4f125b77-e76e-4995-a705-5130440a09e7" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-quobyte-4f125b77-e76e-4995-a705-5130440a09e7" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2652ad-5b5e-4a2d-b15b-6e0e1af12ac4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:28 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7
Sep 25 18:40:28 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:29 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7" returned: 0 in 0.345s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:29 devstack sudo[100893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7
Sep 25 18:40:29 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:29 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4f125b77-e76e-4995-a705-5130440a09e7" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-quobyte-4f125b77-e76e-4995-a705-5130440a09e7" released by "delete_volume" :: held 0.628s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Created reservations ['47d51db8-97cc-4323-81d8-5211778e1cd1', 'b3b7e643-795f-46a9-93f3-ceb93a05fbd9', '527d13c7-1334-4322-a267-c055ef0f3092', '2882122a-114b-4b08-827d-9550a0957a94'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:29 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:29 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:29 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Deleted volume successfully.
Sep 25 18:40:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-aa0649dc-6ee1-4725-83b1-a5b67b95b980 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-4f125b77-e76e-4995-a705-5130440a09e7-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Flow 'volume_create_manager' (e2986147-8edd-4904-b966-a60c2667dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d204c8f0-659e-47b3-a541-5a47a87b4090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d204c8f0-659e-47b3-a541-5a47a87b4090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-198474980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67b1c9e-48e6-4a72-b165-dec5ab58231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba33350a12d4010a55555acc77b15a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:30Z,use_quota=True,user_id='5c7ec3a34aa64f739de138b6db403624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd51841d-64c1-4a6f-8b74-b5401d050c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd51841d-64c1-4a6f-8b74-b5401d050c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd66946a-6b21-4477-9b8a-6c1fde4f41f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd66946a-6b21-4477-9b8a-6c1fde4f41f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67b1c9e-48e6-4a72-b165-dec5ab58231f', 'volume_name': 'volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf79ab1-8877-46e7-9626-832071c49aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf79ab1-8877-46e7-9626-832071c49aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc1d8a-322a-454c-9c2c-6c41feee53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:30 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Volume f67b1c9e-48e6-4a72-b165-dec5ab58231f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f', 'volume_size': 1}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-198474980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67b1c9e-48e6-4a72-b165-dec5ab58231f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba33350a12d4010a55555acc77b15a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:30Z,use_quota=True,user_id='5c7ec3a34aa64f739de138b6db403624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Creating volume f67b1c9e-48e6-4a72-b165-dec5ab58231f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:40:30 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:30 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f 1073741824
Sep 25 18:40:30 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:30 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f 1073741824" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:30 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f
Sep 25 18:40:30 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:30 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:40:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bc1d8a-322a-454c-9c2c-6c41feee53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0cf089-084a-4d50-997d-2574d8811600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:31 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Volume volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f (f67b1c9e-48e6-4a72-b165-dec5ab58231f): created successfully
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0cf089-084a-4d50-997d-2574d8811600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Flow 'volume_create_manager' (e2986147-8edd-4904-b966-a60c2667dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d8ddb2d6-c23d-4981-9715-6138906ff4d5 tempest-VolumesTransfersV357Test-1929127128 None] Created volume successfully.
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Acquiring lock "cinder-f67b1c9e-48e6-4a72-b165-dec5ab58231f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-f67b1c9e-48e6-4a72-b165-dec5ab58231f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Acquiring lock "cinder-quobyte-f67b1c9e-48e6-4a72-b165-dec5ab58231f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-quobyte-f67b1c9e-48e6-4a72-b165-dec5ab58231f" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f6849-ace9-4575-9374-20335297d2c3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:31 devstack sudo[100945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f
Sep 25 18:40:31 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:31 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:31 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f
Sep 25 18:40:31 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:32 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-f67b1c9e-48e6-4a72-b165-dec5ab58231f" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-quobyte-f67b1c9e-48e6-4a72-b165-dec5ab58231f" released by "delete_volume" :: held 0.637s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Created reservations ['da3886a5-97b8-4233-9057-e1ea0ab390fd', '55c7b987-a697-4911-b808-70284d56c044', '3ba9d04a-345d-4e54-a58c-efc115bb8729', '5fce4f95-6264-47e8-9200-38a79967329e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:32 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:32 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:32 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.237s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Deleted volume successfully.
Sep 25 18:40:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-53daf875-076f-49fa-9f6b-c8093cce2831 tempest-VolumesTransfersV357Test-220217948 None] Lock "cinder-f67b1c9e-48e6-4a72-b165-dec5ab58231f-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Flow 'volume_create_manager' (b4fbd83c-7086-4b93-8671-d0ca7d1858df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33eba900-89dc-492c-82f6-43f5f5fb89bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33eba900-89dc-492c-82f6-43f5f5fb89bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1048228009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb6c83d-9ae6-4785-a8e3-66d950971b3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eeaa02c505543238e3219abc95f5016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:38Z,use_quota=True,user_id='dbc576a9021343c4a0bbfa781edb931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c2c167-81f4-40ba-b68e-193572bdfa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c2c167-81f4-40ba-b68e-193572bdfa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e0e9e5-9a1c-4b97-9aef-fa099b4e576f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e0e9e5-9a1c-4b97-9aef-fa099b4e576f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb6c83d-9ae6-4785-a8e3-66d950971b3d', 'volume_name': 'volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2999ff71-4b3e-4cb0-9253-a600176c12ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2999ff71-4b3e-4cb0-9253-a600176c12ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452089e6-1a0f-4a24-9cb6-3abd5dc21b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Volume 9fb6c83d-9ae6-4785-a8e3-66d950971b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d', 'volume_size': 1}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1048228009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb6c83d-9ae6-4785-a8e3-66d950971b3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eeaa02c505543238e3219abc95f5016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:38Z,use_quota=True,user_id='dbc576a9021343c4a0bbfa781edb931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Creating volume 9fb6c83d-9ae6-4785-a8e3-66d950971b3d {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:40:38 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:38 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d 1073741824
Sep 25 18:40:38 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:38 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d 1073741824" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:38 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d
Sep 25 18:40:38 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:38 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452089e6-1a0f-4a24-9cb6-3abd5dc21b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a354f49e-e9cf-4ab8-a273-bbf3a38428b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Volume volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d (9fb6c83d-9ae6-4785-a8e3-66d950971b3d): created successfully
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a354f49e-e9cf-4ab8-a273-bbf3a38428b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Flow 'volume_create_manager' (b4fbd83c-7086-4b93-8671-d0ca7d1858df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fbba31a9-88f5-4170-ae76-b56a9b5978e0 tempest-VolumesListTestJSON-1478664493 None] Created volume successfully.
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Flow 'volume_create_manager' (b2041d33-4bc8-4556-8b25-55473f446dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b75bd70-a7cc-4f0f-b2f3-0244ef546d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b75bd70-a7cc-4f0f-b2f3-0244ef546d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-633204703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7114b95f-56be-4aad-b33b-131063b3c9b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eeaa02c505543238e3219abc95f5016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:40Z,use_quota=True,user_id='dbc576a9021343c4a0bbfa781edb931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b272480b-666b-48ce-95a9-5e054db37747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b272480b-666b-48ce-95a9-5e054db37747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587949a1-6e25-4467-a412-e2e3be45aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587949a1-6e25-4467-a412-e2e3be45aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7114b95f-56be-4aad-b33b-131063b3c9b5', 'volume_name': 'volume-7114b95f-56be-4aad-b33b-131063b3c9b5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7586ea93-b80d-49e6-9f64-f223e393b480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7586ea93-b80d-49e6-9f64-f223e393b480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9273eb44-9c9e-43ea-ba38-70865774090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:39 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Volume 7114b95f-56be-4aad-b33b-131063b3c9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7114b95f-56be-4aad-b33b-131063b3c9b5', 'volume_size': 1}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-633204703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7114b95f-56be-4aad-b33b-131063b3c9b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eeaa02c505543238e3219abc95f5016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:40Z,use_quota=True,user_id='dbc576a9021343c4a0bbfa781edb931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Creating volume 7114b95f-56be-4aad-b33b-131063b3c9b5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:40:39 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:40:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:39 devstack sudo[100972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5 1073741824
Sep 25 18:40:39 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:40 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5 1073741824" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:40 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5
Sep 25 18:40:40 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:40 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9273eb44-9c9e-43ea-ba38-70865774090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7114b95f-56be-4aad-b33b-131063b3c9b5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2eecd8e-391a-40b1-a134-35036d9d45ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:40 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Volume volume-7114b95f-56be-4aad-b33b-131063b3c9b5 (7114b95f-56be-4aad-b33b-131063b3c9b5): created successfully
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2eecd8e-391a-40b1-a134-35036d9d45ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Flow 'volume_create_manager' (b2041d33-4bc8-4556-8b25-55473f446dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4a318a85-e843-4a48-b21c-152c50bf0f40 tempest-VolumesListTestJSON-1478664493 None] Created volume successfully.
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Flow 'volume_create_manager' (237b8555-5eb4-4455-95de-0ac8abb748f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992a2766-0a57-4e2c-9a88-7ece36997af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992a2766-0a57-4e2c-9a88-7ece36997af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1685536197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f25ea4c-737c-4981-9027-cae472ed2028,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eeaa02c505543238e3219abc95f5016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:41Z,use_quota=True,user_id='dbc576a9021343c4a0bbfa781edb931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c9f97d-8bd4-47ae-8b61-af39071f09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c9f97d-8bd4-47ae-8b61-af39071f09a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61413688-73c8-4058-a501-4fde27e0ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61413688-73c8-4058-a501-4fde27e0ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f25ea4c-737c-4981-9027-cae472ed2028', 'volume_name': 'volume-1f25ea4c-737c-4981-9027-cae472ed2028', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151fe622-c7d9-498c-af9a-2884387314db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151fe622-c7d9-498c-af9a-2884387314db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d40f7c-ab98-4712-b663-c410317f14f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Volume 1f25ea4c-737c-4981-9027-cae472ed2028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f25ea4c-737c-4981-9027-cae472ed2028', 'volume_size': 1}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1685536197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f25ea4c-737c-4981-9027-cae472ed2028,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5eeaa02c505543238e3219abc95f5016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:40:41Z,use_quota=True,user_id='dbc576a9021343c4a0bbfa781edb931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Creating volume 1f25ea4c-737c-4981-9027-cae472ed2028 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:40:41 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:41 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028 1073741824
Sep 25 18:40:41 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:41 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028 1073741824" returned: 0 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:41 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028
Sep 25 18:40:41 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:41 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d40f7c-ab98-4712-b663-c410317f14f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f25ea4c-737c-4981-9027-cae472ed2028', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f63bbb5-58db-4ee8-9fa6-c201b3abb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:40:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Volume volume-1f25ea4c-737c-4981-9027-cae472ed2028 (1f25ea4c-737c-4981-9027-cae472ed2028): created successfully
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f63bbb5-58db-4ee8-9fa6-c201b3abb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:40:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Flow 'volume_create_manager' (237b8555-5eb4-4455-95de-0ac8abb748f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:40:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1fd03c5b-de9f-482f-9764-90fe5a31e104 tempest-VolumesListTestJSON-1478664493 None] Created volume successfully.
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "cinder-1f25ea4c-737c-4981-9027-cae472ed2028-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-1f25ea4c-737c-4981-9027-cae472ed2028-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "cinder-quobyte-1f25ea4c-737c-4981-9027-cae472ed2028" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-quobyte-1f25ea4c-737c-4981-9027-cae472ed2028" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f174dce9-0c77-4176-8332-004644ca3f2f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:44 devstack sudo[100988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028
Sep 25 18:40:44 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:44 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:44 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:44 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:44 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028" returned: 0 in 0.354s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:44 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028
Sep 25 18:40:44 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:44 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1f25ea4c-737c-4981-9027-cae472ed2028" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-quobyte-1f25ea4c-737c-4981-9027-cae472ed2028" released by "delete_volume" :: held 0.633s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Created reservations ['8d5302c8-acb1-480a-8abf-95912224cddc', '29cb300f-f8f4-406e-aa2e-48008c47a997', '9e31da9a-c6e8-4b32-8ad2-6e35b9b73957', 'a4ab2348-f537-4545-a73b-bfb48b0ef141'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:44 devstack sudo[100999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:44 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:45 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.237s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:45 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Deleted volume successfully.
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-22b161f1-e3b0-47b9-8bf5-089bcb96a015 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-1f25ea4c-737c-4981-9027-cae472ed2028-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "cinder-7114b95f-56be-4aad-b33b-131063b3c9b5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-7114b95f-56be-4aad-b33b-131063b3c9b5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "cinder-quobyte-7114b95f-56be-4aad-b33b-131063b3c9b5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-quobyte-7114b95f-56be-4aad-b33b-131063b3c9b5" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0c94eb-a5e8-4abc-8ba4-d8937aca1918]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:45 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5
Sep 25 18:40:45 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:45 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5" returned: 0 in 0.346s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:45 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5
Sep 25 18:40:45 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:45 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-7114b95f-56be-4aad-b33b-131063b3c9b5" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-quobyte-7114b95f-56be-4aad-b33b-131063b3c9b5" released by "delete_volume" :: held 0.623s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:45 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Created reservations ['89d5c7f7-f3c8-487f-900b-4acef2c050c0', 'c8c04d54-23b3-4e03-b124-4568146a4fa5', '5e1c8c4f-b179-4cc6-916b-f2a4d3a09906', '604d8824-60c9-4e3c-9817-14c2f025ffd4'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:46 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:46 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:46 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.236s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Deleted volume successfully.
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-1346a5b6-2d32-4348-a31e-96ae1f0944b5 tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-7114b95f-56be-4aad-b33b-131063b3c9b5-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "cinder-9fb6c83d-9ae6-4785-a8e3-66d950971b3d-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-9fb6c83d-9ae6-4785-a8e3-66d950971b3d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "cinder-quobyte-9fb6c83d-9ae6-4785-a8e3-66d950971b3d" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-quobyte-9fb6c83d-9ae6-4785-a8e3-66d950971b3d" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf37b00e-1341-4b5d-bc90-adfd238c0671]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:46 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d
Sep 25 18:40:46 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:46 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d" returned: 0 in 0.342s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:46 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d
Sep 25 18:40:46 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:47 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9fb6c83d-9ae6-4785-a8e3-66d950971b3d" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-quobyte-9fb6c83d-9ae6-4785-a8e3-66d950971b3d" released by "delete_volume" :: held 0.618s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Created reservations ['3b7d462a-8065-4995-8d8a-f5212fd54f2d', '51660bd8-31f4-4eaf-a012-a8415fa87c6e', 'bc2ae3a3-19a2-43d4-bb7e-62b31bac3f05', '1d0d180c-6eca-4b9d-8e74-9978b462081e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:40:47 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:40:47 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:40:47 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:40:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Deleted volume successfully.
Sep 25 18:40:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d0081ff3-587c-4d20-893e-29b2824a01be tempest-VolumesListTestJSON-1478664493 None] Lock "cinder-9fb6c83d-9ae6-4785-a8e3-66d950971b3d-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:40:57 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=56,cinder:INSERT=25,cinder:UPDATE=66,cinder:DELETE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:40:57 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=44,cinder:UPDATE=69,cinder:INSERT=18,cinder:DELETE=10 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:41:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Flow 'volume_create_manager' (e2d26a23-a357-4823-b9c3-9a9b3a850bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1e3c56-2469-43ff-bb25-32970e50f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1e3c56-2469-43ff-bb25-32970e50f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1785349601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d42560e-37df-49f0-b099-cd97d1c5a995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2639f4c370e34997bb7a1d282e6f7e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:41:20Z,use_quota=True,user_id='2b266d622fe94bad97bd36015bdb8a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ae1ddc-09f0-4e2f-aa91-684b82653b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ae1ddc-09f0-4e2f-aa91-684b82653b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07538e12-b063-409e-ad7c-4f94cdd10769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07538e12-b063-409e-ad7c-4f94cdd10769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d42560e-37df-49f0-b099-cd97d1c5a995', 'volume_name': 'volume-0d42560e-37df-49f0-b099-cd97d1c5a995', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8417fd-42a9-4307-920d-2bc20bd5904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8417fd-42a9-4307-920d-2bc20bd5904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e4282-746d-4766-9648-e6c4f4d90c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:41:19 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Volume 0d42560e-37df-49f0-b099-cd97d1c5a995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d42560e-37df-49f0-b099-cd97d1c5a995', 'volume_size': 1}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1785349601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d42560e-37df-49f0-b099-cd97d1c5a995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2639f4c370e34997bb7a1d282e6f7e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:41:20Z,use_quota=True,user_id='2b266d622fe94bad97bd36015bdb8a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Creating volume 0d42560e-37df-49f0-b099-cd97d1c5a995 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:41:19 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:41:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:41:19 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995 1073741824
Sep 25 18:41:19 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:41:20 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995 1073741824" returned: 0 in 0.424s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:41:20 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995
Sep 25 18:41:20 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:41:20 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e4282-746d-4766-9648-e6c4f4d90c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d42560e-37df-49f0-b099-cd97d1c5a995', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc922434-5af9-4939-879d-71c03dfa5b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:41:20 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Volume volume-0d42560e-37df-49f0-b099-cd97d1c5a995 (0d42560e-37df-49f0-b099-cd97d1c5a995): created successfully
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc922434-5af9-4939-879d-71c03dfa5b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:41:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Flow 'volume_create_manager' (e2d26a23-a357-4823-b9c3-9a9b3a850bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:41:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7671f319-7b9b-4052-9d17-cf2d7c2521cc tempest-TestMinimumBasicScenario-1990986947 None] Created volume successfully.
Sep 25 18:41:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-452e7164-7766-4bd9-8b4b-40ef0c55971d req-3ae194fb-850c-4407-afe2-7e8058b35fd9 tempest-TestMinimumBasicScenario-1990986947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:41:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-452e7164-7766-4bd9-8b4b-40ef0c55971d req-3ae194fb-850c-4407-afe2-7e8058b35fd9 tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:41:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-452e7164-7766-4bd9-8b4b-40ef0c55971d req-3ae194fb-850c-4407-afe2-7e8058b35fd9 tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:41:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-452e7164-7766-4bd9-8b4b-40ef0c55971d req-3ae194fb-850c-4407-afe2-7e8058b35fd9 tempest-TestMinimumBasicScenario-1990986947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-0d42560e-37df-49f0-b099-cd97d1c5a995', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '137fdb79-7b75-4a01-901b-78371bbcf16b', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:41:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-452e7164-7766-4bd9-8b4b-40ef0c55971d req-3ae194fb-850c-4407-afe2-7e8058b35fd9 tempest-TestMinimumBasicScenario-1990986947 None] attachment_update completed successfully.
Sep 25 18:41:31 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:41:31 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:41:44 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:41:44 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:41:44 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.247s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:41:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:42:09 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-5156b0fc-0079-4a03-a574-b383e3c7447c req-74a16e14-bcf7-4960-a2b5-8435742c9348 tempest-TestMinimumBasicScenario-1990986947 None] Terminate volume connection completed successfully.
Sep 25 18:42:09 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-5156b0fc-0079-4a03-a574-b383e3c7447c req-74a16e14-bcf7-4960-a2b5-8435742c9348 tempest-TestMinimumBasicScenario-1990986947 None] Deleting attachment 137fdb79-7b75-4a01-901b-78371bbcf16b. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Acquiring lock "cinder-0d42560e-37df-49f0-b099-cd97d1c5a995-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Lock "cinder-0d42560e-37df-49f0-b099-cd97d1c5a995-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Acquiring lock "cinder-quobyte-0d42560e-37df-49f0-b099-cd97d1c5a995" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Lock "cinder-quobyte-0d42560e-37df-49f0-b099-cd97d1c5a995" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b695c205-b2ef-4275-bd09-2ea2c41e7330]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:42:10 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995
Sep 25 18:42:10 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:42:10 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:42:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:42:10 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995
Sep 25 18:42:10 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:42:11 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0d42560e-37df-49f0-b099-cd97d1c5a995" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Lock "cinder-quobyte-0d42560e-37df-49f0-b099-cd97d1c5a995" released by "delete_volume" :: held 0.648s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Created reservations ['9ff0ecfa-eb12-4fc4-af95-f1a2b80632a0', '541b2ec7-bc44-410c-886a-a5d848f86dad', '3b2facd8-fc3c-49c4-8203-312ebeaf2069', '0da94d7f-9d85-43b6-b723-8cc73453c6cf'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:42:11 devstack sudo[101769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:42:11 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:42:11 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:42:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Deleted volume successfully.
Sep 25 18:42:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-483fac32-e0a3-4606-a2ee-bedc84cf9284 tempest-TestMinimumBasicScenario-1990986947 None] Lock "cinder-0d42560e-37df-49f0-b099-cd97d1c5a995-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:42:21 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:42:21 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:42:44 devstack sudo[101850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:42:44 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:42:44 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:42:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Flow 'volume_create_manager' (2ee3d34c-b870-4c42-8e59-8c800d6d3f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3818c21e-cbdf-43ec-a422-2430226feedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3818c21e-cbdf-43ec-a422-2430226feedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-55513608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d1ce8e-778b-4e46-92d7-30ea8804bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125b8fec88044239a1313cf45690b4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:43:12Z,use_quota=True,user_id='96f939ecf3784f7c91ef125ff43c9998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086c6f8-b50b-48c6-9326-190dd2cdfbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086c6f8-b50b-48c6-9326-190dd2cdfbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624ac726-b339-4007-bcd4-c3d91f70f794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624ac726-b339-4007-bcd4-c3d91f70f794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d1ce8e-778b-4e46-92d7-30ea8804bab6', 'volume_name': 'volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc5a0e7-583b-4003-a243-3565d0ec33bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc5a0e7-583b-4003-a243-3565d0ec33bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c842f-a6fd-406e-bf75-4c27d0377ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:12 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Volume d9d1ce8e-778b-4e46-92d7-30ea8804bab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6', 'volume_size': 1}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-55513608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d1ce8e-778b-4e46-92d7-30ea8804bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125b8fec88044239a1313cf45690b4ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:43:12Z,use_quota=True,user_id='96f939ecf3784f7c91ef125ff43c9998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Creating volume d9d1ce8e-778b-4e46-92d7-30ea8804bab6 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:43:12 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:12 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 1073741824
Sep 25 18:43:12 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:12 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 1073741824" returned: 0 in 0.393s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:12 devstack sudo[101991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6
Sep 25 18:43:12 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:13 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6" returned: 0 in 0.234s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c842f-a6fd-406e-bf75-4c27d0377ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9303260a-5cf3-471b-8efb-ccb652dffb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:13 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Volume volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 (d9d1ce8e-778b-4e46-92d7-30ea8804bab6): created successfully
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9303260a-5cf3-471b-8efb-ccb652dffb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Flow 'volume_create_manager' (2ee3d34c-b870-4c42-8e59-8c800d6d3f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:43:13 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-75e40c05-ba5d-4456-819c-b79494bef2cb tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Created volume successfully.
Sep 25 18:43:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-eca83cec-1909-4026-a47e-064f05a68afe req-5c9cb839-62e4-4c2a-b727-705f0dbc2f05 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-eca83cec-1909-4026-a47e-064f05a68afe req-5c9cb839-62e4-4c2a-b727-705f0dbc2f05 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-eca83cec-1909-4026-a47e-064f05a68afe req-5c9cb839-62e4-4c2a-b727-705f0dbc2f05 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:14 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-eca83cec-1909-4026-a47e-064f05a68afe req-5c9cb839-62e4-4c2a-b727-705f0dbc2f05 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5958e151-def7-49a9-b5c1-36b6eb847829', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:43:14 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-eca83cec-1909-4026-a47e-064f05a68afe req-5c9cb839-62e4-4c2a-b727-705f0dbc2f05 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] attachment_update completed successfully.
Sep 25 18:43:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-ac142d51-d1e6-4316-a73a-f5d1588de517 req-6c961e12-2504-4d33-b6b1-6eaadb30e9df tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Terminate volume connection completed successfully.
Sep 25 18:43:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-ac142d51-d1e6-4316-a73a-f5d1588de517 req-6c961e12-2504-4d33-b6b1-6eaadb30e9df tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Deleting attachment 5958e151-def7-49a9-b5c1-36b6eb847829. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Acquiring lock "cinder-d9d1ce8e-778b-4e46-92d7-30ea8804bab6-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "cinder-d9d1ce8e-778b-4e46-92d7-30ea8804bab6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Acquiring lock "cinder-quobyte-d9d1ce8e-778b-4e46-92d7-30ea8804bab6" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "cinder-quobyte-d9d1ce8e-778b-4e46-92d7-30ea8804bab6" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd7191-9a5d-496e-9fea-05fab420436a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:18 devstack sudo[102459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6
Sep 25 18:43:18 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:18 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6" returned: 0 in 0.355s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:18 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6
Sep 25 18:43:18 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:19 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-d9d1ce8e-778b-4e46-92d7-30ea8804bab6" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "cinder-quobyte-d9d1ce8e-778b-4e46-92d7-30ea8804bab6" released by "delete_volume" :: held 0.644s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Created reservations ['b92db8fc-c571-407f-baa5-8ea22e930e98', '9c529fa3-558f-4719-afc1-7537f8b24b9e', 'b7056401-49ab-4cbf-8666-92183d73e82b', 'ef8a3979-2a3c-4108-92b8-6bfa025a68fe'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:19 devstack sudo[102467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:43:19 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:19 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:43:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Deleted volume successfully.
Sep 25 18:43:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fc832e95-a9a0-4f83-9ae8-fb23129f2a61 tempest-TestServerVolumeAttachScenarioOldVersion-742196286 None] Lock "cinder-d9d1ce8e-778b-4e46-92d7-30ea8804bab6-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:43:29 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=14,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:43:29 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=12,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:44 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:43:44 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:44 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:43:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Flow 'volume_create_manager' (f3ff42f8-05e2-41cc-87bd-21156a2a6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377da484-930b-481b-a9aa-42ea6ab8c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377da484-930b-481b-a9aa-42ea6ab8c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107841471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6129add3-d4a0-4aec-9521-c6f156545750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c50a418f1d418c93054fef6f5d6e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:43:53Z,use_quota=True,user_id='236d19d4e81f4840991a952f5d15400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ec827f-73aa-4218-a6cf-28347300f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ec827f-73aa-4218-a6cf-28347300f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfde5525-3a83-42a2-be05-5e99f77e0508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfde5525-3a83-42a2-be05-5e99f77e0508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6129add3-d4a0-4aec-9521-c6f156545750', 'volume_name': 'volume-6129add3-d4a0-4aec-9521-c6f156545750', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dc420c-1591-47d0-9c4e-1e9d9d0b55ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dc420c-1591-47d0-9c4e-1e9d9d0b55ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4902b64-f103-42a2-89b0-c36bfa603bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Volume 6129add3-d4a0-4aec-9521-c6f156545750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6129add3-d4a0-4aec-9521-c6f156545750', 'volume_size': 1}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107841471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6129add3-d4a0-4aec-9521-c6f156545750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c50a418f1d418c93054fef6f5d6e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:43:53Z,use_quota=True,user_id='236d19d4e81f4840991a952f5d15400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Creating volume 6129add3-d4a0-4aec-9521-c6f156545750 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:43:52 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:43:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:52 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750 1073741824
Sep 25 18:43:52 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Flow 'volume_create_manager' (c63b5209-cbbe-4cb6-b4e8-b49bd501f396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b37a33-e50e-4786-9251-202643c159aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b37a33-e50e-4786-9251-202643c159aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1359654199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9853e32a-577c-497c-98df-c47ef4bae219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c50a418f1d418c93054fef6f5d6e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:43:53Z,use_quota=True,user_id='236d19d4e81f4840991a952f5d15400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704b626-7484-43ff-a7c7-8ccc58c17ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3704b626-7484-43ff-a7c7-8ccc58c17ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc727bc-c1c5-4c8b-93d4-23425732f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc727bc-c1c5-4c8b-93d4-23425732f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9853e32a-577c-497c-98df-c47ef4bae219', 'volume_name': 'volume-9853e32a-577c-497c-98df-c47ef4bae219', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f2ee7f-ec50-4dd7-ae7a-9caabd59e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f2ee7f-ec50-4dd7-ae7a-9caabd59e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbb277e-ad24-46b2-8439-64ab213a4d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Volume 9853e32a-577c-497c-98df-c47ef4bae219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9853e32a-577c-497c-98df-c47ef4bae219', 'volume_size': 1}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:53 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750 1073741824" returned: 0 in 0.510s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:53 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750
Sep 25 18:43:53 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:53 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1359654199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9853e32a-577c-497c-98df-c47ef4bae219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c50a418f1d418c93054fef6f5d6e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:43:53Z,use_quota=True,user_id='236d19d4e81f4840991a952f5d15400f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Creating volume 9853e32a-577c-497c-98df-c47ef4bae219 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:43:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:53 devstack sudo[102562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219 1073741824
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4902b64-f103-42a2-89b0-c36bfa603bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6129add3-d4a0-4aec-9521-c6f156545750', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:53 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c27d68-47c7-4c9e-b6ac-cb6925919877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Volume volume-6129add3-d4a0-4aec-9521-c6f156545750 (6129add3-d4a0-4aec-9521-c6f156545750): created successfully
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c27d68-47c7-4c9e-b6ac-cb6925919877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Flow 'volume_create_manager' (f3ff42f8-05e2-41cc-87bd-21156a2a6b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:43:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0ea6659c-60b3-431d-8266-b62008a4c39a tempest-TestServerVolumeAttachmentScenario-937057649 None] Created volume successfully.
Sep 25 18:43:54 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219 1073741824" returned: 0 in 0.474s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:43:54 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219
Sep 25 18:43:54 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:43:54 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbb277e-ad24-46b2-8439-64ab213a4d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9853e32a-577c-497c-98df-c47ef4bae219', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9431492e-7cd2-44b8-b2e3-15c972945425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:43:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Volume volume-9853e32a-577c-497c-98df-c47ef4bae219 (9853e32a-577c-497c-98df-c47ef4bae219): created successfully
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9431492e-7cd2-44b8-b2e3-15c972945425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:43:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Flow 'volume_create_manager' (c63b5209-cbbe-4cb6-b4e8-b49bd501f396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:43:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a1d6cf94-80b1-441c-9341-7a5f2b66f996 tempest-TestServerVolumeAttachmentScenario-937057649 None] Created volume successfully.
Sep 25 18:44:04 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:44:04 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:44:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-8ea49843-93eb-490b-9d34-570d7556672f req-ea644f4c-1a63-4ea5-a021-2667ebe16ec6 tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:44:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-8ea49843-93eb-490b-9d34-570d7556672f req-ea644f4c-1a63-4ea5-a021-2667ebe16ec6 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:44:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-8ea49843-93eb-490b-9d34-570d7556672f req-ea644f4c-1a63-4ea5-a021-2667ebe16ec6 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:44:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-8ea49843-93eb-490b-9d34-570d7556672f req-ea644f4c-1a63-4ea5-a021-2667ebe16ec6 tempest-TestServerVolumeAttachmentScenario-937057649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-6129add3-d4a0-4aec-9521-c6f156545750', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '312ec835-e95d-48ad-bff7-3840333cea5d', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:44:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-8ea49843-93eb-490b-9d34-570d7556672f req-ea644f4c-1a63-4ea5-a021-2667ebe16ec6 tempest-TestServerVolumeAttachmentScenario-937057649 None] attachment_update completed successfully.
Sep 25 18:44:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-8e421a30-a676-4820-85db-f358578e43fb req-9de6cd9b-aa26-4929-9e4c-fc4a2a6a2f10 tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:44:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-8e421a30-a676-4820-85db-f358578e43fb req-9de6cd9b-aa26-4929-9e4c-fc4a2a6a2f10 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:44:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-8e421a30-a676-4820-85db-f358578e43fb req-9de6cd9b-aa26-4929-9e4c-fc4a2a6a2f10 tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:44:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-8e421a30-a676-4820-85db-f358578e43fb req-9de6cd9b-aa26-4929-9e4c-fc4a2a6a2f10 tempest-TestServerVolumeAttachmentScenario-937057649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-9853e32a-577c-497c-98df-c47ef4bae219', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82271e87-a7f7-471e-8b40-e0dc5416f7bc', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:44:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-8e421a30-a676-4820-85db-f358578e43fb req-9de6cd9b-aa26-4929-9e4c-fc4a2a6a2f10 tempest-TestServerVolumeAttachmentScenario-937057649 None] attachment_update completed successfully.
Sep 25 18:44:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-65e13ad4-c45e-4667-be99-8ceed13e3589 req-830e3a7e-dbd2-4fce-96c1-640c9f948f91 tempest-TestServerVolumeAttachmentScenario-937057649 None] Terminate volume connection completed successfully.
Sep 25 18:44:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-65e13ad4-c45e-4667-be99-8ceed13e3589 req-830e3a7e-dbd2-4fce-96c1-640c9f948f91 tempest-TestServerVolumeAttachmentScenario-937057649 None] Deleting attachment 82271e87-a7f7-471e-8b40-e0dc5416f7bc. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:44:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-b4c01712-f577-428c-9f30-a13c01f20eeb req-cdbdd536-b076-41a5-8331-17419042c6df tempest-TestServerVolumeAttachmentScenario-937057649 None] Terminate volume connection completed successfully.
Sep 25 18:44:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-b4c01712-f577-428c-9f30-a13c01f20eeb req-cdbdd536-b076-41a5-8331-17419042c6df tempest-TestServerVolumeAttachmentScenario-937057649 None] Deleting attachment 312ec835-e95d-48ad-bff7-3840333cea5d. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "cinder-9853e32a-577c-497c-98df-c47ef4bae219-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-9853e32a-577c-497c-98df-c47ef4bae219-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "cinder-quobyte-9853e32a-577c-497c-98df-c47ef4bae219" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-quobyte-9853e32a-577c-497c-98df-c47ef4bae219" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7107960-7021-4c96-828a-c10d6062a1ac]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:35 devstack sudo[103253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219
Sep 25 18:44:35 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:35 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219" returned: 0 in 0.342s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:35 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219
Sep 25 18:44:35 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:36 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9853e32a-577c-497c-98df-c47ef4bae219" returned: 0 in 0.233s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-quobyte-9853e32a-577c-497c-98df-c47ef4bae219" released by "delete_volume" :: held 0.617s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Created reservations ['5e5d1440-7d95-413d-b71d-951aa08cbd44', 'cab6fcf3-f927-4c38-abe1-cd9f540092af', 'aa560a9a-e937-48de-8bb0-5c9af5b133b9', '86deb7f3-85d3-4fec-a42f-c65b180476cc'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:36 devstack sudo[103261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:44:36 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:36 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:44:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Deleted volume successfully.
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3223f19-d76b-48ce-84f5-cbea1d336f6f tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-9853e32a-577c-497c-98df-c47ef4bae219-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "cinder-6129add3-d4a0-4aec-9521-c6f156545750-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-6129add3-d4a0-4aec-9521-c6f156545750-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "cinder-quobyte-6129add3-d4a0-4aec-9521-c6f156545750" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-quobyte-6129add3-d4a0-4aec-9521-c6f156545750" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36aec27-403c-45f1-95a6-c6ecb310f9f9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:44:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:36 devstack sudo[103264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750
Sep 25 18:44:36 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:37 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750" returned: 0 in 0.341s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:37 devstack sudo[103269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750
Sep 25 18:44:37 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:37 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6129add3-d4a0-4aec-9521-c6f156545750" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-quobyte-6129add3-d4a0-4aec-9521-c6f156545750" released by "delete_volume" :: held 0.615s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Created reservations ['e97820b2-039e-415b-98b9-83f5ef9c4793', '8e559522-4745-44cf-bacc-5fcafffd7fea', '157292b0-767b-4e30-ba45-05bfdd86aac1', '28d0b610-c19d-46e5-af38-a91c05b0b3e5'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:37 devstack sudo[103272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:44:37 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:37 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:44:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Deleted volume successfully.
Sep 25 18:44:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-142dd380-c4da-43df-8c13-d3a3094a279e tempest-TestServerVolumeAttachmentScenario-937057649 None] Lock "cinder-6129add3-d4a0-4aec-9521-c6f156545750-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:44:44 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:44:44 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:44:44 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:44:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:44:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:44:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=29,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Flow 'volume_create_manager' (1b4462d6-59fb-4097-b25a-44701389fc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb29d80e-6da7-4a6d-bb53-30fe6f1f4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb29d80e-6da7-4a6d-bb53-30fe6f1f4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-134739394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4211fa09-e73f-4627-9061-ccaaebb370bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e88bed610141c898618479b4a97559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:45:07Z,use_quota=True,user_id='3faf4bf72b1b4784b4f661c298cc568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ea6baa-402a-4d6a-a401-7137612e6894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ea6baa-402a-4d6a-a401-7137612e6894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a99fc15-a389-41ef-8051-c0b2f4c95e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a99fc15-a389-41ef-8051-c0b2f4c95e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4211fa09-e73f-4627-9061-ccaaebb370bb', 'volume_name': 'volume-4211fa09-e73f-4627-9061-ccaaebb370bb', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb82d94c0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df27820-60f1-42b5-8d0f-3aa38f258d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df27820-60f1-42b5-8d0f-3aa38f258d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9879d7cb-4597-460b-8cf6-7189aacfb995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:45:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Volume 4211fa09-e73f-4627-9061-ccaaebb370bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4211fa09-e73f-4627-9061-ccaaebb370bb', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb82d94c0>}
Sep 25 18:45:07 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Trying to clone 4211fa09-e73f-4627-9061-ccaaebb370bb from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:45:08 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Image download 20.69 MB at 20.69 MB/s
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3092e-27d9-40cf-b00f-d7aada2660c2]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:08 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD
Sep 25 18:45:08 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:08 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 is fetched for user 3faf4bf72b1b4784b4f661c298cc568f. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95dac02-60c9-4fab-9f70-72140755a865]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:08 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD
Sep 25 18:45:08 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:08 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-134739394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4211fa09-e73f-4627-9061-ccaaebb370bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e88bed610141c898618479b4a97559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:45:07Z,use_quota=True,user_id='3faf4bf72b1b4784b4f661c298cc568f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Creating volume 4211fa09-e73f-4627-9061-ccaaebb370bb {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:45:08 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:45:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:08 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb 1073741824
Sep 25 18:45:08 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:09 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb 1073741824" returned: 0 in 0.412s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:09 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb
Sep 25 18:45:09 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:09 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Attempting download of 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 4211fa09-e73f-4627-9061-ccaaebb370bb. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[613bf74e-0384-4b4f-bb99-77cac6f4e8f9]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:09 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4
Sep 25 18:45:09 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:09 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4" returned: 0 in 0.331s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:10 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4
Sep 25 18:45:10 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:10 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4" returned: 1 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_6o9oeax4' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d16452-113e-4795-b59f-5fd019dfd064]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:10 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD
Sep 25 18:45:10 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:10 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 was qcow2, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:45:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:10 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb
Sep 25 18:45:10 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:12 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb" returned: 0 in 1.603s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ac8bde6-b5af-4fec-a7d5-d3b13e624c48_vf3vlfm2devstack@QuobyteHD, size 112.00 MB, duration 1.60 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:45:12 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Converted 112.00 MB image at 69.83 MB/s
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:12 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb 1G
Sep 25 18:45:12 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:12 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb 1G" returned: 0 in 0.302s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Downloaded image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}])) to volume 4211fa09-e73f-4627-9061-ccaaebb370bb successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Temporary image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 for user 3faf4bf72b1b4784b4f661c298cc568f is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Marking volume 4211fa09-e73f-4627-9061-ccaaebb370bb as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Copying metadata from image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 to 4211fa09-e73f-4627-9061-ccaaebb370bb. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Creating volume glance metadata for volume 4211fa09-e73f-4627-9061-ccaaebb370bb backed by image 4ac8bde6-b5af-4fec-a7d5-d3b13e624c48 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9879d7cb-4597-460b-8cf6-7189aacfb995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4211fa09-e73f-4627-9061-ccaaebb370bb', 'volume_size': 1, 'image_id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8eeae14356c64972a640bfa5c5c1186f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ac8bde6-b5af-4fec-a7d5-d3b13e624c48', 'created_at': datetime.datetime(2026, 9, 25, 16, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 20, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ac8bde6-b5af-4fec-a7d5-d3b13e624c48/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb82d94c0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b001cbc-fbbf-4089-86d6-387f79cf0d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:45:12 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Volume volume-4211fa09-e73f-4627-9061-ccaaebb370bb (4211fa09-e73f-4627-9061-ccaaebb370bb): created successfully
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b001cbc-fbbf-4089-86d6-387f79cf0d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:45:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Flow 'volume_create_manager' (1b4462d6-59fb-4097-b25a-44701389fc36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:45:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-95b402ef-6605-49da-954e-c8433fcd9120 tempest-TestShelveInstance-1122976665 None] Created volume successfully.
Sep 25 18:45:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-a01a5d2f-60a0-4668-984e-ee21edbaea8f req-db4dab35-b6c4-4222-88b8-60b03b47a528 tempest-TestShelveInstance-1122976665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:45:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-a01a5d2f-60a0-4668-984e-ee21edbaea8f req-db4dab35-b6c4-4222-88b8-60b03b47a528 tempest-TestShelveInstance-1122976665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:45:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-a01a5d2f-60a0-4668-984e-ee21edbaea8f req-db4dab35-b6c4-4222-88b8-60b03b47a528 tempest-TestShelveInstance-1122976665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:45:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-a01a5d2f-60a0-4668-984e-ee21edbaea8f req-db4dab35-b6c4-4222-88b8-60b03b47a528 tempest-TestShelveInstance-1122976665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-4211fa09-e73f-4627-9061-ccaaebb370bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84f3df55-906b-41cf-a08a-8c89f3490c61', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:45:15 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-a01a5d2f-60a0-4668-984e-ee21edbaea8f req-db4dab35-b6c4-4222-88b8-60b03b47a528 tempest-TestShelveInstance-1122976665 None] attachment_update completed successfully.
Sep 25 18:45:25 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=20,cinder:UPDATE=4,cinder:INSERT=6 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:45:25 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=9,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:45:44 devstack sudo[103948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:45:44 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:45:44 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:45:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:45:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-5dad6efb-31b7-4946-b5d7-15d56d3ab805 req-ba88fbbd-b6eb-47c3-bb8d-46b1e90add4e tempest-TestShelveInstance-1122976665 None] Terminate volume connection completed successfully.
Sep 25 18:45:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-5dad6efb-31b7-4946-b5d7-15d56d3ab805 req-ba88fbbd-b6eb-47c3-bb8d-46b1e90add4e tempest-TestShelveInstance-1122976665 None] Deleting attachment 84f3df55-906b-41cf-a08a-8c89f3490c61. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:45:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-3b8e2859-e3ac-40ce-8e09-53c432312d7d req-5d712c60-1283-471f-8d8e-8b3c96c61d74 tempest-TestShelveInstance-1122976665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:45:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-3b8e2859-e3ac-40ce-8e09-53c432312d7d req-5d712c60-1283-471f-8d8e-8b3c96c61d74 tempest-TestShelveInstance-1122976665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:45:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-3b8e2859-e3ac-40ce-8e09-53c432312d7d req-5d712c60-1283-471f-8d8e-8b3c96c61d74 tempest-TestShelveInstance-1122976665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:45:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-3b8e2859-e3ac-40ce-8e09-53c432312d7d req-5d712c60-1283-471f-8d8e-8b3c96c61d74 tempest-TestShelveInstance-1122976665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-4211fa09-e73f-4627-9061-ccaaebb370bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e78e5ca-2a18-4e9f-98e0-7ecaee63d914', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:45:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-3b8e2859-e3ac-40ce-8e09-53c432312d7d req-5d712c60-1283-471f-8d8e-8b3c96c61d74 tempest-TestShelveInstance-1122976665 None] attachment_update completed successfully.
Sep 25 18:45:58 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:45:58 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:46:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-40ba8c74-aa3d-4f1d-a786-fc102b46da9a tempest-TestShelveInstance-1122976665 None] Terminate volume connection completed successfully.
Sep 25 18:46:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-40ba8c74-aa3d-4f1d-a786-fc102b46da9a tempest-TestShelveInstance-1122976665 None] Deleting attachment 4e78e5ca-2a18-4e9f-98e0-7ecaee63d914. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:46:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Acquiring lock "cinder-4211fa09-e73f-4627-9061-ccaaebb370bb-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Lock "cinder-4211fa09-e73f-4627-9061-ccaaebb370bb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Acquiring lock "cinder-quobyte-4211fa09-e73f-4627-9061-ccaaebb370bb" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Lock "cinder-quobyte-4211fa09-e73f-4627-9061-ccaaebb370bb" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd606ad-5bb4-42a6-90fa-7f02ce13df55]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:46:18 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb
Sep 25 18:46:18 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:46:18 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb" returned: 0 in 0.399s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:46:18 devstack sudo[104565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb
Sep 25 18:46:18 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:46:18 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-4211fa09-e73f-4627-9061-ccaaebb370bb" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Lock "cinder-quobyte-4211fa09-e73f-4627-9061-ccaaebb370bb" released by "delete_volume" :: held 0.706s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.quota [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Created reservations ['8c293737-a755-4ac2-8bed-6f3dfd1fc93c', 'fd4e17d7-b63c-4a0e-9978-61e3a9717621', '8d64780b-fb5e-417a-9ccc-fc5427b97b6a', 'fa109cbf-ed3b-46cb-b96c-e6efa12c124e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:46:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:46:18 devstack sudo[104569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:46:18 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:46:19 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root
Sep 25 18:46:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:46:19 devstack cinder-volume[86534]: DEBUG cinder.manager [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:46:19 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Deleted volume successfully.
Sep 25 18:46:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [req-60aeb6c0-a6c9-41b9-8dac-6858025a55e0 req-7d725fc5-742f-4742-a8f6-db6212f6d254 tempest-TestShelveInstance-1122976665 None] Lock "cinder-4211fa09-e73f-4627-9061-ccaaebb370bb-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:46:28 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:46:29 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:46:44 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:46:44 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:46:44 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:46:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Flow 'volume_create_manager' (f4f12fae-56a0-4600-8200-266850837fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826ecab8-57c7-46f6-ae24-3df29158fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826ecab8-57c7-46f6-ae24-3df29158fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-549874269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a69d8a-cb8d-44f4-b45f-44f3add457fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c29981a43dc4109a308de274448bd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:46:48Z,use_quota=True,user_id='c556658abf8945ac8ea6da4d93a95a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cd70c-82dd-4831-b95a-ed4c8791f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cd70c-82dd-4831-b95a-ed4c8791f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a287381c-ddef-4a1f-8d23-26e8f11d489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a287381c-ddef-4a1f-8d23-26e8f11d489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7a69d8a-cb8d-44f4-b45f-44f3add457fe', 'volume_name': 'volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf6df1d-2fbb-4ffc-a479-32ddbdb7312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf6df1d-2fbb-4ffc-a479-32ddbdb7312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd19da9-0b32-4b3b-86f4-393bb023535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:46:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Volume a7a69d8a-cb8d-44f4-b45f-44f3add457fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe', 'volume_size': 1}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-549874269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a69d8a-cb8d-44f4-b45f-44f3add457fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c29981a43dc4109a308de274448bd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:46:48Z,use_quota=True,user_id='c556658abf8945ac8ea6da4d93a95a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Creating volume a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:46:47 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:46:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:46:47 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe 1073741824
Sep 25 18:46:47 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:46:48 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe 1073741824" returned: 0 in 0.460s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:46:48 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe
Sep 25 18:46:48 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:46:48 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd19da9-0b32-4b3b-86f4-393bb023535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbfcd70-befc-4e18-bbbe-40ba9feecd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:46:48 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Volume volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe (a7a69d8a-cb8d-44f4-b45f-44f3add457fe): created successfully
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbfcd70-befc-4e18-bbbe-40ba9feecd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:46:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Flow 'volume_create_manager' (f4f12fae-56a0-4600-8200-266850837fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:46:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-934f9ba4-6701-4408-b1ad-d0b06bb9baf3 tempest-TestStampPattern-1391850460 None] Created volume successfully.
Sep 25 18:46:58 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:46:58 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:47:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:47:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-da5912ae-85dc-4f9d-a5d5-ea1f7ae84f34 req-826cd60e-54d6-4819-9b45-221c5c802285 tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:47:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-da5912ae-85dc-4f9d-a5d5-ea1f7ae84f34 req-826cd60e-54d6-4819-9b45-221c5c802285 tempest-TestStampPattern-1391850460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:47:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-da5912ae-85dc-4f9d-a5d5-ea1f7ae84f34 req-826cd60e-54d6-4819-9b45-221c5c802285 tempest-TestStampPattern-1391850460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:47:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-da5912ae-85dc-4f9d-a5d5-ea1f7ae84f34 req-826cd60e-54d6-4819-9b45-221c5c802285 tempest-TestStampPattern-1391850460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a81a296f-d627-47c3-8c08-a15654f56f04', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:47:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-da5912ae-85dc-4f9d-a5d5-ea1f7ae84f34 req-826cd60e-54d6-4819-9b45-221c5c802285 tempest-TestStampPattern-1391850460 None] attachment_update completed successfully.
Sep 25 18:47:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-d791b85b-af02-40c8-a0dc-dcf9d41f6715 req-cdfd3a9d-39f0-4fdb-8a4d-5421ecbcc74e tempest-TestStampPattern-1391850460 None] Terminate volume connection completed successfully.
Sep 25 18:47:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-d791b85b-af02-40c8-a0dc-dcf9d41f6715 req-cdfd3a9d-39f0-4fdb-8a4d-5421ecbcc74e tempest-TestStampPattern-1391850460 None] Deleting attachment a81a296f-d627-47c3-8c08-a15654f56f04. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:47:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:47:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:47:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Creating offline snapshot 51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 of volume a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:47:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa918698-fcf1-45a4-ac11-660a1d7043f9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:47:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:23 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe
Sep 25 18:47:23 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:24 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:24 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 1G
Sep 25 18:47:24 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:24 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 1G" returned: 0 in 0.376s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:24 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0
Sep 25 18:47:24 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:24 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" returned: 0 in 0.298s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:24 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 is being set with open permissions: ugo+rw
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:24 devstack sudo[105268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0
Sep 25 18:47:24 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:24 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" returned: 0 in 0.234s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:25 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info
Sep 25 18:47:25 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:25 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:25 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info is being set with open permissions: ugo+rw
Sep 25 18:47:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:25 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info
Sep 25 18:47:25 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:25 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.info" returned: 0 in 0.237s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:47:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c33eb03c-1ab3-4194-839e-d9e1fd2a97c9 tempest-TestStampPattern-1391850460 None] Create snapshot completed successfully
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Flow 'volume_create_manager' (6f9dd7bd-0e31-4696-84cd-4eb28bf5ca3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230fa8b7-901b-44d7-a072-d6dec05ee747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230fa8b7-901b-44d7-a072-d6dec05ee747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-603436601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dab111b-50cc-49ae-a068-c4f542f8a89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c29981a43dc4109a308de274448bd06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51a6e680-d7a9-4e01-8d3e-98ddb7d746b0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:47:32Z,use_quota=True,user_id='c556658abf8945ac8ea6da4d93a95a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e3a2d0-404b-45e4-8b59-7dd93dbcae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e3a2d0-404b-45e4-8b59-7dd93dbcae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd6fe7d-51c5-469c-8f3a-f34916e3af1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd6fe7d-51c5-469c-8f3a-f34916e3af1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3dab111b-50cc-49ae-a068-c4f542f8a89c', 'volume_name': 'volume-3dab111b-50cc-49ae-a068-c4f542f8a89c', 'volume_size': 1, 'snapshot_id': '51a6e680-d7a9-4e01-8d3e-98ddb7d746b0'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0697f03-3ecf-40e0-accb-4832b3c76ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0697f03-3ecf-40e0-accb-4832b3c76ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857d714e-abab-48eb-8451-5c3759af9edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:47:32 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Volume 3dab111b-50cc-49ae-a068-c4f542f8a89c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3dab111b-50cc-49ae-a068-c4f542f8a89c', 'volume_size': 1, 'snapshot_id': '51a6e680-d7a9-4e01-8d3e-98ddb7d746b0'}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-quobyte-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0-3dab111b-50cc-49ae-a068-c4f542f8a89c" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0-3dab111b-50cc-49ae-a068-c4f542f8a89c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Creating volume 3dab111b-50cc-49ae-a068-c4f542f8a89c from snapshot 51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-quobyte-3dab111b-50cc-49ae-a068-c4f542f8a89c" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-3dab111b-50cc-49ae-a068-c4f542f8a89c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] snapshot: 51a6e680-d7a9-4e01-8d3e-98ddb7d746b0, volume: 3dab111b-50cc-49ae-a068-c4f542f8a89c,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[65906f61-6452-4229-883d-a89a89ff6684]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:47:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:32 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0
Sep 25 18:47:32 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:33 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2797af-8501-48f1-b15c-5992e52d9f97]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:33 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe
Sep 25 18:47:33 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:33 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" returned: 0 in 0.400s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:47:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:33 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c
Sep 25 18:47:33 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c" returned: 0 in 8.065s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe, size 1024.00 MB, duration 8.07 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:47:41 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Converted 1024.00 MB image at 126.94 MB/s
Sep 25 18:47:41 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c is being set with open permissions: ugo+rw
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:41 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c
Sep 25 18:47:41 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:41 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c" returned: 0 in 0.271s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-3dab111b-50cc-49ae-a068-c4f542f8a89c" released by "_copy_volume_from_snapshot" :: held 9.226s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0-3dab111b-50cc-49ae-a068-c4f542f8a89c" released by "_create_volume_from_snapshot" :: held 9.311s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.329s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:47:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857d714e-abab-48eb-8451-5c3759af9edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dab111b-50cc-49ae-a068-c4f542f8a89c', 'volume_size': 1, 'snapshot_id': '51a6e680-d7a9-4e01-8d3e-98ddb7d746b0'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:47:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5098c0be-dc6f-48b7-a94c-1f7472baa0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:47:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Volume volume-3dab111b-50cc-49ae-a068-c4f542f8a89c (3dab111b-50cc-49ae-a068-c4f542f8a89c): created successfully
Sep 25 18:47:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5098c0be-dc6f-48b7-a94c-1f7472baa0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:47:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Flow 'volume_create_manager' (6f9dd7bd-0e31-4696-84cd-4eb28bf5ca3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:47:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e11a6f83-a4de-4792-b5c3-9e76c598c18b tempest-TestStampPattern-1391850460 None] Created volume successfully.
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:47:44 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:47:44 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:47:44 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:47:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:47:52 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:47:52 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:48:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-0e896052-ac0b-4702-b4ce-9aa564556d15 req-5085c346-32bd-4846-a7d4-6bf2c714c880 tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-0e896052-ac0b-4702-b4ce-9aa564556d15 req-5085c346-32bd-4846-a7d4-6bf2c714c880 tempest-TestStampPattern-1391850460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [req-0e896052-ac0b-4702-b4ce-9aa564556d15 req-5085c346-32bd-4846-a7d4-6bf2c714c880 tempest-TestStampPattern-1391850460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-0e896052-ac0b-4702-b4ce-9aa564556d15 req-5085c346-32bd-4846-a7d4-6bf2c714c880 tempest-TestStampPattern-1391850460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2', 'name': 'volume-3dab111b-50cc-49ae-a068-c4f542f8a89c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01c0650d-bfd2-4e6c-a088-dcf5641bbe13', 'enforce_multipath': True} {{(pid=86534) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 25 18:48:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-0e896052-ac0b-4702-b4ce-9aa564556d15 req-5085c346-32bd-4846-a7d4-6bf2c714c880 tempest-TestStampPattern-1391850460 None] attachment_update completed successfully.
Sep 25 18:48:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [req-68f5c713-b480-443e-b199-f8d55d0a3ae9 req-ba9c14fc-0678-4352-b2fd-0e79676080cb tempest-TestStampPattern-1391850460 None] Terminate volume connection completed successfully.
Sep 25 18:48:25 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [req-68f5c713-b480-443e-b199-f8d55d0a3ae9 req-ba9c14fc-0678-4352-b2fd-0e79676080cb tempest-TestStampPattern-1391850460 None] Deleting attachment 01c0650d-bfd2-4e6c-a088-dcf5641bbe13. {{(pid=86534) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-3dab111b-50cc-49ae-a068-c4f542f8a89c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Lock "cinder-3dab111b-50cc-49ae-a068-c4f542f8a89c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-quobyte-3dab111b-50cc-49ae-a068-c4f542f8a89c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-3dab111b-50cc-49ae-a068-c4f542f8a89c" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac49815e-aaf1-4f29-a70e-1ad2527b6544]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:29 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c
Sep 25 18:48:29 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:29 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c" returned: 0 in 0.351s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:29 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c
Sep 25 18:48:29 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:30 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3dab111b-50cc-49ae-a068-c4f542f8a89c" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-3dab111b-50cc-49ae-a068-c4f542f8a89c" released by "delete_volume" :: held 0.635s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Created reservations ['d8fdf5f0-6e10-4bf8-840d-e67b769ca779', '078847ef-c175-410f-aa90-99bde7e4fc64', '3a860e49-3754-4451-97df-ab5643ebfe9a', 'f7997893-1238-4436-b3b8-2e913745d728'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:30 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:48:30 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:30 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.262s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:48:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Deleted volume successfully.
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef511610-40bc-457f-b407-5813ca5a2a78 tempest-TestStampPattern-1391850460 None] Lock "cinder-3dab111b-50cc-49ae-a068-c4f542f8a89c-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Lock "cinder-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-quobyte-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-quobyte-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Deleting offline snapshot 51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 of volume a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] snapshot_file for this snap is: volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c1ec83-a277-44b5-b239-8147a5645846]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:31 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0
Sep 25 18:48:31 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:31 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" returned: 0 in 0.362s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:48:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec707b2a-f15b-46ec-8072-393f5bf2fc44]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:31 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe
Sep 25 18:48:31 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:31 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" returned: 0 in 0.508s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:31 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0
Sep 25 18:48:31 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:32 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" returned: 0 in 0.328s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:32 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0
Sep 25 18:48:32 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:32 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe.51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0" released by "_delete_snapshot" :: held 1.544s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" released by "delete_snapshot" :: held 1.565s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Created reservations ['daf765ba-7e5f-4b15-b0e6-36b6c93a32b0', '30b03bd3-a26a-4173-92d5-9fe8277d9fcd', '07764824-bf8d-48c5-a279-44f61d967d6c', '1bc895a5-8e76-4956-a4b4-87950e7adb9c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:48:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Delete snapshot completed successfully.
Sep 25 18:48:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-08cc3e20-b19a-48d6-90f0-31aa16c4c522 tempest-TestStampPattern-1391850460 None] Lock "cinder-51a6e680-d7a9-4e01-8d3e-98ddb7d746b0-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-a7a69d8a-cb8d-44f4-b45f-44f3add457fe-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Lock "cinder-a7a69d8a-cb8d-44f4-b45f-44f3add457fe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Acquiring lock "cinder-quobyte-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c32b83-8a30-4e4e-94fd-ec68f16c478c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:36 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe
Sep 25 18:48:36 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:36 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" returned: 0 in 0.354s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:36 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe
Sep 25 18:48:36 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:37 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Lock "cinder-quobyte-a7a69d8a-cb8d-44f4-b45f-44f3add457fe" released by "delete_volume" :: held 0.661s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Created reservations ['d4f85376-f37e-4e0d-acce-f182f88304d6', '6a9685cc-1709-4272-b562-3368371ca7be', 'd8e89b70-c16a-454f-bab3-77649514c8ba', 'bc37d655-a84d-4289-a9fe-69f8cab00504'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:37 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:48:37 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:37 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:48:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Deleted volume successfully.
Sep 25 18:48:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c7801596-bfe8-4762-8a6d-c58f685c037f tempest-TestStampPattern-1391850460 None] Lock "cinder-a7a69d8a-cb8d-44f4-b45f-44f3add457fe-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:44 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:48:44 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:44 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.274s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:48:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:48:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:48:47 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:48:48 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (654aeda7-8f84-44c0-a8ab-1694647eb4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2532e9d4-2967-4303-b78f-56a9b258127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2532e9d4-2967-4303-b78f-56a9b258127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691716216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33df2845-63fa-49ee-88da-c03fd22d292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:49Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91b275b-380b-4f8d-bd67-1bf8e3d2dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91b275b-380b-4f8d-bd67-1bf8e3d2dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708e02ea-8732-4b28-b42c-e18ad81545f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708e02ea-8732-4b28-b42c-e18ad81545f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33df2845-63fa-49ee-88da-c03fd22d292a', 'volume_name': 'volume-33df2845-63fa-49ee-88da-c03fd22d292a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b41f0e-5a46-4102-ab7f-18d82abde55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b41f0e-5a46-4102-ab7f-18d82abde55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486a0a3c-2121-4ea3-addc-436d41b09b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume 33df2845-63fa-49ee-88da-c03fd22d292a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33df2845-63fa-49ee-88da-c03fd22d292a', 'volume_size': 1}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1691716216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33df2845-63fa-49ee-88da-c03fd22d292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:49Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating volume 33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:48:49 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:49 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a 1073741824
Sep 25 18:48:49 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:49 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a 1073741824" returned: 0 in 0.416s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:49 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a
Sep 25 18:48:49 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:49 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a" returned: 0 in 0.238s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486a0a3c-2121-4ea3-addc-436d41b09b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33df2845-63fa-49ee-88da-c03fd22d292a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee78c6b-f487-4017-9b07-f669eeecdea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume volume-33df2845-63fa-49ee-88da-c03fd22d292a (33df2845-63fa-49ee-88da-c03fd22d292a): created successfully
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee78c6b-f487-4017-9b07-f669eeecdea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (654aeda7-8f84-44c0-a8ab-1694647eb4aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0137d0ae-bd2b-4d9b-a560-9d7cdadb2645 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created volume successfully.
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating offline snapshot f64e555b-013f-4999-bb12-220bb4a37b58 of volume 33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cba9ec-23e7-4aee-8be8-b3ba0fd4d5ca]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:50 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a
Sep 25 18:48:50 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:50 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a" returned: 0 in 0.365s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:50 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 1G
Sep 25 18:48:50 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:50 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 1G" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33df2845-63fa-49ee-88da-c03fd22d292a -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:50 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33df2845-63fa-49ee-88da-c03fd22d292a -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58
Sep 25 18:48:50 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:51 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33df2845-63fa-49ee-88da-c03fd22d292a -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58" returned: 0 in 0.285s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 is being set with open permissions: ugo+rw
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:51 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58
Sep 25 18:48:51 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:51 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58" returned: 0 in 0.234s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:51 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info
Sep 25 18:48:51 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:51 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info is being set with open permissions: ugo+rw
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:51 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info
Sep 25 18:48:51 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:51 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.info" returned: 0 in 0.236s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-29eb0d84-430d-4057-a07f-62a67c830a3b tempest-CreateVolumesFromSnapshotTest-1367524997 None] Create snapshot completed successfully
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (8653fce5-2ba6-4d66-931c-8a422e13916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec35ab-1109-44ab-ae99-17ea7b7fcee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec35ab-1109-44ab-ae99-17ea7b7fcee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390266373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcaffa5a-6457-4cf8-966d-874e268ef843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:53Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414fbbec-026e-40af-90d3-3ee7976ac6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414fbbec-026e-40af-90d3-3ee7976ac6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc656b16-0d94-48e2-a8c4-fb220c059b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc656b16-0d94-48e2-a8c4-fb220c059b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcaffa5a-6457-4cf8-966d-874e268ef843', 'volume_name': 'volume-fcaffa5a-6457-4cf8-966d-874e268ef843', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423b9cb3-999e-40df-9c43-5b1b4647726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423b9cb3-999e-40df-9c43-5b1b4647726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3f748-52a3-4a69-9391-5b1bef1de82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume fcaffa5a-6457-4cf8-966d-874e268ef843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcaffa5a-6457-4cf8-966d-874e268ef843', 'volume_size': 1}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390266373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcaffa5a-6457-4cf8-966d-874e268ef843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:53Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating volume fcaffa5a-6457-4cf8-966d-874e268ef843 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:48:52 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:48:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:52 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843 1073741824
Sep 25 18:48:52 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (3d1f54e8-b863-4de0-b85a-b4bd6cc12032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eae922-ce59-40e8-b9d6-860908a6fd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eae922-ce59-40e8-b9d6-860908a6fd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171146461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a5bbc9-9df2-424b-9a4f-024ccb89e4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:53Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519df78b-9f35-4b0a-b6c5-6e7d06efce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519df78b-9f35-4b0a-b6c5-6e7d06efce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2418cef-d35c-44ae-9cad-6012b7ea7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2418cef-d35c-44ae-9cad-6012b7ea7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a5bbc9-9df2-424b-9a4f-024ccb89e4db', 'volume_name': 'volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2735eb-b343-48ec-b2da-6e2f425c929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2735eb-b343-48ec-b2da-6e2f425c929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3f784d-756a-42a7-9a45-969cfcfdb9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume e4a5bbc9-9df2-424b-9a4f-024ccb89e4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db', 'volume_size': 1}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:53 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843 1073741824" returned: 0 in 0.499s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:53 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843
Sep 25 18:48:53 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (38007526-3559-47b1-b7d8-32dc5a3a9e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea7c8d0-8b7f-4302-be46-fe3fb2a26414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea7c8d0-8b7f-4302-be46-fe3fb2a26414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161170579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96926559-8d26-4b36-80ce-ec802c366596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:53Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9936d6b-93a8-4fa4-bc6d-b0cb4dd58180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9936d6b-93a8-4fa4-bc6d-b0cb4dd58180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd7264-5906-4a06-9a0a-de1f753b6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fd7264-5906-4a06-9a0a-de1f753b6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96926559-8d26-4b36-80ce-ec802c366596', 'volume_name': 'volume-96926559-8d26-4b36-80ce-ec802c366596', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f67ad2-d9c6-4e70-baa7-4b90d75cd839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f67ad2-d9c6-4e70-baa7-4b90d75cd839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533f1dc3-c0d4-4ea5-a1a4-202005ddd05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume 96926559-8d26-4b36-80ce-ec802c366596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96926559-8d26-4b36-80ce-ec802c366596', 'volume_size': 1}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:53 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843" returned: 0 in 0.273s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171146461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a5bbc9-9df2-424b-9a4f-024ccb89e4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:53Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating volume e4a5bbc9-9df2-424b-9a4f-024ccb89e4db {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:48:53 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:53 devstack sudo[106187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db 1073741824
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d3f748-52a3-4a69-9391-5b1bef1de82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcaffa5a-6457-4cf8-966d-874e268ef843', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06353d4b-634e-4814-9c72-a3fcd8deda93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume volume-fcaffa5a-6457-4cf8-966d-874e268ef843 (fcaffa5a-6457-4cf8-966d-874e268ef843): created successfully
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06353d4b-634e-4814-9c72-a3fcd8deda93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (8653fce5-2ba6-4d66-931c-8a422e13916e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-114a61cd-0380-4090-b376-addd57114529 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created volume successfully.
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (cbcad0b3-2cf8-44eb-8959-d790e3d5c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f52640e-9971-4967-b26a-01e1faea5d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f52640e-9971-4967-b26a-01e1faea5d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1734513948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fc93b6-78bd-42c3-936a-3d0c514db1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:54Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cedaf1a-446c-438d-b2e2-94e9419f5b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cedaf1a-446c-438d-b2e2-94e9419f5b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21aafca1-2713-48bb-9232-0fa8510f99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21aafca1-2713-48bb-9232-0fa8510f99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76fc93b6-78bd-42c3-936a-3d0c514db1a1', 'volume_name': 'volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4fc3da-dab1-4458-a238-8678cf2333fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4fc3da-dab1-4458-a238-8678cf2333fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3af634e-7080-4707-b845-a2a1e849a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume 76fc93b6-78bd-42c3-936a-3d0c514db1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1', 'volume_size': 1}
Sep 25 18:48:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:54 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db 1073741824" returned: 0 in 0.523s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (f5021547-686e-40ad-ba85-11ff95810f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137d815a-e2c0-490a-9bf0-52cc22fe87d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:54 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db
Sep 25 18:48:54 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137d815a-e2c0-490a-9bf0-52cc22fe87d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665101251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e010e33-7150-445d-ab0f-ca2d348c81fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:54Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1af5c99-10b6-498c-86e3-708b607d4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1af5c99-10b6-498c-86e3-708b607d4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fbdfb7-4112-4ec2-8530-6025510152a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fbdfb7-4112-4ec2-8530-6025510152a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e010e33-7150-445d-ab0f-ca2d348c81fe', 'volume_name': 'volume-0e010e33-7150-445d-ab0f-ca2d348c81fe', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d70c39-34a2-4949-a184-d40de10e51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d70c39-34a2-4949-a184-d40de10e51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf99c6-df8f-436a-a6de-e87db6b29eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume 0e010e33-7150-445d-ab0f-ca2d348c81fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e010e33-7150-445d-ab0f-ca2d348c81fe', 'volume_size': 1}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:54 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161170579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96926559-8d26-4b36-80ce-ec802c366596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:53Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating volume 96926559-8d26-4b36-80ce-ec802c366596 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:48:54 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3f784d-756a-42a7-9a45-969cfcfdb9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:54 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596 1073741824
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e787fcfc-fc3a-435b-9bab-2151f421568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:54 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db (e4a5bbc9-9df2-424b-9a4f-024ccb89e4db): created successfully
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e787fcfc-fc3a-435b-9bab-2151f421568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (3d1f54e8-b863-4de0-b85a-b4bd6cc12032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cf938469-b7fd-4d5a-8109-76068255e6f6 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created volume successfully.
Sep 25 18:48:54 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596 1073741824" returned: 0 in 0.404s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:54 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596
Sep 25 18:48:54 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:55 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1734513948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76fc93b6-78bd-42c3-936a-3d0c514db1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:54Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating volume 76fc93b6-78bd-42c3-936a-3d0c514db1a1 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:48:55 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533f1dc3-c0d4-4ea5-a1a4-202005ddd05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96926559-8d26-4b36-80ce-ec802c366596', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:55 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 1073741824
Sep 25 18:48:55 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1072b96-6a69-4dae-8798-d70647d96847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:55 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume volume-96926559-8d26-4b36-80ce-ec802c366596 (96926559-8d26-4b36-80ce-ec802c366596): created successfully
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1072b96-6a69-4dae-8798-d70647d96847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (38007526-3559-47b1-b7d8-32dc5a3a9e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cf213bd0-309a-447c-ae9f-d3c4c1501ac1 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created volume successfully.
Sep 25 18:48:55 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 1073741824" returned: 0 in 0.405s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:55 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1
Sep 25 18:48:55 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:55 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665101251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e010e33-7150-445d-ab0f-ca2d348c81fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e53811a6dc3940ddb589017cec9a6c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:48:54Z,use_quota=True,user_id='dbdc9363b0d5494b955a48e24381a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Creating volume 0e010e33-7150-445d-ab0f-ca2d348c81fe {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:48:55 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3af634e-7080-4707-b845-a2a1e849a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b95004b-2bbd-411c-af27-288ddd10fce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:55 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe 1073741824
Sep 25 18:48:55 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:55 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 (76fc93b6-78bd-42c3-936a-3d0c514db1a1): created successfully
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b95004b-2bbd-411c-af27-288ddd10fce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (cbcad0b3-2cf8-44eb-8959-d790e3d5c05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9272006a-d11d-419e-8651-b57d28f28ad4 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created volume successfully.
Sep 25 18:48:56 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe 1073741824" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:56 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe
Sep 25 18:48:56 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:56 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf99c6-df8f-436a-a6de-e87db6b29eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e010e33-7150-445d-ab0f-ca2d348c81fe', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14ffc4a-e061-4ddc-879d-4abac0fa4fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:48:56 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Volume volume-0e010e33-7150-445d-ab0f-ca2d348c81fe (0e010e33-7150-445d-ab0f-ca2d348c81fe): created successfully
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14ffc4a-e061-4ddc-879d-4abac0fa4fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:48:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Flow 'volume_create_manager' (f5021547-686e-40ad-ba85-11ff95810f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:48:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-30507f79-a9b6-40bf-94c6-35080dbaed72 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created volume successfully.
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-0e010e33-7150-445d-ab0f-ca2d348c81fe-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-0e010e33-7150-445d-ab0f-ca2d348c81fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-0e010e33-7150-445d-ab0f-ca2d348c81fe" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-0e010e33-7150-445d-ab0f-ca2d348c81fe" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f49229-a3ec-4ae6-b19f-123bb7fbcd42]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:57 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe
Sep 25 18:48:57 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:57 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:57 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe
Sep 25 18:48:57 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:58 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-0e010e33-7150-445d-ab0f-ca2d348c81fe" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-0e010e33-7150-445d-ab0f-ca2d348c81fe" released by "delete_volume" :: held 0.633s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['8469eb6b-ae66-4e15-b395-ec1ce9d93f2a', '52bab8b2-6e80-4302-a890-994ff0895add', '4ecbc89c-e422-4d7f-acf9-b640f7af532b', '91fc6cc3-6d88-4a1f-b82a-aa02b6c9b1f8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:58 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:48:58 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:58 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.254s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:48:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleted volume successfully.
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5f16b871-c384-4f44-941c-83aceaeb91d7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-0e010e33-7150-445d-ab0f-ca2d348c81fe-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-76fc93b6-78bd-42c3-936a-3d0c514db1a1-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-76fc93b6-78bd-42c3-936a-3d0c514db1a1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-76fc93b6-78bd-42c3-936a-3d0c514db1a1" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-76fc93b6-78bd-42c3-936a-3d0c514db1a1" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b4d9d-9ab8-4506-aa96-0149aabc4db8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:58 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1
Sep 25 18:48:58 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:59 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1" returned: 0 in 0.346s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:59 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1
Sep 25 18:48:59 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:59 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76fc93b6-78bd-42c3-936a-3d0c514db1a1" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-76fc93b6-78bd-42c3-936a-3d0c514db1a1" released by "delete_volume" :: held 0.637s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['06963f96-c08d-4fdc-b885-97c140456a3a', '0d937622-620e-4e22-81c6-5f67313bebc6', 'b97f77ba-8d7a-47a4-b54a-7d78f4814c56', '6994aeff-aa37-4430-a357-c0bead57a88d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:48:59 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:48:59 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:48:59 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.247s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:48:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleted volume successfully.
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9050023c-b492-44ad-889e-d6a9dcfb75b7 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-76fc93b6-78bd-42c3-936a-3d0c514db1a1-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-96926559-8d26-4b36-80ce-ec802c366596-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-96926559-8d26-4b36-80ce-ec802c366596-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-96926559-8d26-4b36-80ce-ec802c366596" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-96926559-8d26-4b36-80ce-ec802c366596" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73132ee9-f38c-4a77-9438-bac78c8903a0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:48:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:00 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596
Sep 25 18:49:00 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:00 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596" returned: 0 in 0.356s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:00 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596
Sep 25 18:49:00 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:00 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96926559-8d26-4b36-80ce-ec802c366596" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-96926559-8d26-4b36-80ce-ec802c366596" released by "delete_volume" :: held 0.638s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['043f7c5b-90fe-47d1-bfe1-83614e89f7f9', '100e4b55-9946-4880-8b89-1d7d22659e24', '43ebbad6-035d-4368-85bc-b9814071a4dd', 'a3860d6f-8dd1-462e-b205-cf6cdbd7d77a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:00 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:00 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:00 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleted volume successfully.
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb8a43b7-6fb0-4a6c-801a-ea18156ec1b9 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-96926559-8d26-4b36-80ce-ec802c366596-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db" acquired by "delete_volume" :: waited 0.012s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af85c59-297d-4de6-9e50-aea1b8d82150]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:01 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db
Sep 25 18:49:01 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:01 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db" returned: 0 in 0.365s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:01 devstack sudo[106262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db
Sep 25 18:49:01 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:01 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db" released by "delete_volume" :: held 0.655s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['12a4bea0-984f-4a02-9ac0-86a0ffdb5831', '5683141a-8073-4754-a9be-d45f4bf5f42e', '0ad9b0b6-b5f0-47b0-a9a9-1db1e4201f79', 'ae49aaec-1a7a-4874-8185-23e5b93a5294'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:01 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:01 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:02 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:02 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleted volume successfully.
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-bb7c8f51-f7e2-425b-9777-85c080e87d35 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-e4a5bbc9-9df2-424b-9a4f-024ccb89e4db-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-fcaffa5a-6457-4cf8-966d-874e268ef843-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-fcaffa5a-6457-4cf8-966d-874e268ef843-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-fcaffa5a-6457-4cf8-966d-874e268ef843" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-fcaffa5a-6457-4cf8-966d-874e268ef843" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6518ce-16ce-4da0-9479-d63d08bd4735]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:02 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843
Sep 25 18:49:02 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:02 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843" returned: 0 in 0.365s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:02 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843
Sep 25 18:49:02 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:02 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-fcaffa5a-6457-4cf8-966d-874e268ef843" returned: 0 in 0.247s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-fcaffa5a-6457-4cf8-966d-874e268ef843" released by "delete_volume" :: held 0.656s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['c0cbc4b3-748f-4407-bdb8-a428edf929f1', '51328798-cc0d-4fae-89ca-de66ae955c97', 'ea21388e-4410-45df-b249-50b7e3c23282', '49923523-3200-415f-9b3d-bf39e3932071'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:03 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:03 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:03 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleted volume successfully.
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2f87455-d35a-44cc-be51-cf6ee47a2db3 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-fcaffa5a-6457-4cf8-966d-874e268ef843-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-f64e555b-013f-4999-bb12-220bb4a37b58-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-f64e555b-013f-4999-bb12-220bb4a37b58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-33df2845-63fa-49ee-88da-c03fd22d292a" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-33df2845-63fa-49ee-88da-c03fd22d292a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-f64e555b-013f-4999-bb12-220bb4a37b58" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-f64e555b-013f-4999-bb12-220bb4a37b58" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleting offline snapshot f64e555b-013f-4999-bb12-220bb4a37b58 of volume 33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] snapshot_file for this snap is: volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7bddf-759c-4c22-90de-f8fd286c7c93]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:03 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58
Sep 25 18:49:03 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:03 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58" returned: 0 in 0.376s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33df2845-63fa-49ee-88da-c03fd22d292a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ec7a5-5ac1-4132-ad2e-1802cc758d2d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:03 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a
Sep 25 18:49:03 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:04 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:04 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58
Sep 25 18:49:04 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:04 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58" returned: 0 in 0.362s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:04 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58
Sep 25 18:49:04 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:04 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a.f64e555b-013f-4999-bb12-220bb4a37b58" returned: 0 in 0.244s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-f64e555b-013f-4999-bb12-220bb4a37b58" released by "_delete_snapshot" :: held 1.470s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-33df2845-63fa-49ee-88da-c03fd22d292a" released by "delete_snapshot" :: held 1.489s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['1ff4426c-83e3-4949-a6f2-faef3af45b00', '361456da-ac27-43ed-9a3e-db07657754a3', '21f256d9-a1f4-4810-9f28-f3ac88d14a54', '76f75a02-f8db-482c-a4e3-7911dc96f9f7'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Delete snapshot completed successfully.
Sep 25 18:49:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-2d79e8b4-dfb6-4279-99cc-b2bb5f585720 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-f64e555b-013f-4999-bb12-220bb4a37b58-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-33df2845-63fa-49ee-88da-c03fd22d292a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-33df2845-63fa-49ee-88da-c03fd22d292a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "cinder-quobyte-33df2845-63fa-49ee-88da-c03fd22d292a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-33df2845-63fa-49ee-88da-c03fd22d292a" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83052ae-77fd-4a28-821b-4c6165634d2c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:05 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a
Sep 25 18:49:05 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:05 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a" returned: 0 in 0.351s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:05 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a
Sep 25 18:49:05 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:06 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-33df2845-63fa-49ee-88da-c03fd22d292a" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-quobyte-33df2845-63fa-49ee-88da-c03fd22d292a" released by "delete_volume" :: held 0.669s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Created reservations ['5450ed3a-e85c-4135-8cdb-c8a1637bd40a', '411b0f20-665b-4968-9527-1047d0f02b5a', 'ebee6cda-f853-4273-8d05-0a3aa4584662', '3f30d651-2f4c-4829-8b6d-59056db75bb0'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:06 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:06 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:06 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Deleted volume successfully.
Sep 25 18:49:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ee65535f-4ed6-4fb1-a6d5-70808ebf9658 tempest-CreateVolumesFromSnapshotTest-1367524997 None] Lock "cinder-33df2845-63fa-49ee-88da-c03fd22d292a-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Flow 'volume_create_manager' (29e32e66-879e-4a6d-90c4-0beb07b45ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2a5ae7-7930-41b7-baad-7403b03e1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2a5ae7-7930-41b7-baad-7403b03e1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9195b6d7-f06c-4d0b-96e6-35004a8d1eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c1cd2cdba34fcdb898906d5e4f89f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:11Z,use_quota=True,user_id='b6c38345159445dd8e46e3bcac049e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1625cd-4971-44da-9fd8-26114408f50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1625cd-4971-44da-9fd8-26114408f50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c4ec44-bf24-4277-bbcf-31c295af44e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c4ec44-bf24-4277-bbcf-31c295af44e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9195b6d7-f06c-4d0b-96e6-35004a8d1eb6', 'volume_name': 'volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6', 'volume_size': 1, 'image_id': '8fedba75-d76c-425f-8f14-a384246916e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fedba75-d76c-425f-8f14-a384246916e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91f2dec1556ac86b9d679e1a1859464e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31c1cd2cdba34fcdb898906d5e4f89f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '306f12b0e254450a15442adf1877c1c3db4df42654ee231cb8fe48b7d24ee43824723e56b043d2d9ff77bd1f23aa8b2a246eb68f65aebeccc7a03024c08e41e6', 'id': '8fedba75-d76c-425f-8f14-a384246916e1', 'created_at': datetime.datetime(2026, 9, 25, 16, 49, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 49, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fedba75-d76c-425f-8f14-a384246916e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb8323080>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbb6ae4-6e8e-4685-b322-73dd446720c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cbb6ae4-6e8e-4685-b322-73dd446720c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932fa08e-8faa-439a-bb96-49b415a4020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:11 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Volume 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6', 'volume_size': 1, 'image_id': '8fedba75-d76c-425f-8f14-a384246916e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fedba75-d76c-425f-8f14-a384246916e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91f2dec1556ac86b9d679e1a1859464e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31c1cd2cdba34fcdb898906d5e4f89f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '306f12b0e254450a15442adf1877c1c3db4df42654ee231cb8fe48b7d24ee43824723e56b043d2d9ff77bd1f23aa8b2a246eb68f65aebeccc7a03024c08e41e6', 'id': '8fedba75-d76c-425f-8f14-a384246916e1', 'created_at': datetime.datetime(2026, 9, 25, 16, 49, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 49, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fedba75-d76c-425f-8f14-a384246916e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb8323080>}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Trying to clone 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 from image 8fedba75-d76c-425f-8f14-a384246916e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8fedba75-d76c-425f-8f14-a384246916e1', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:49:11 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b968613-2b45-4d2f-a0c2-e0746b545e72]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:11 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD
Sep 25 18:49:11 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:12 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:12 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD
Sep 25 18:49:12 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:12 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Temporary image 8fedba75-d76c-425f-8f14-a384246916e1 is fetched for user b6c38345159445dd8e46e3bcac049e65. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b990594-d5dd-4043-9617-48f360dca49f]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:12 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD
Sep 25 18:49:12 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:12 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:12 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD
Sep 25 18:49:12 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:13 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9195b6d7-f06c-4d0b-96e6-35004a8d1eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c1cd2cdba34fcdb898906d5e4f89f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:11Z,use_quota=True,user_id='b6c38345159445dd8e46e3bcac049e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Creating volume 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:13 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:13 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 1073741824
Sep 25 18:49:13 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:13 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 1073741824" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:13 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6
Sep 25 18:49:13 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:13 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" returned: 0 in 0.237s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Attempting download of 8fedba75-d76c-425f-8f14-a384246916e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8fedba75-d76c-425f-8f14-a384246916e1', 'metadata': {}}])) to volume 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae9ed3-c42a-4f31-8237-8a8edd13c4bd]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_ {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:13 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_
Sep 25 18:49:13 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:14 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_" returned: 0 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_ {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:14 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_
Sep 25 18:49:14 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:14 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_" returned: 1 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fedba75-d76c-425f-8f14-a384246916e1_82txn8n_' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4f8e77-bb29-4d0b-a51c-9c8eaa9c584f]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:14 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD
Sep 25 18:49:14 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:14 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:14 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD
Sep 25 18:49:14 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:15 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] 8fedba75-d76c-425f-8f14-a384246916e1 was raw, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:15 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6
Sep 25 18:49:15 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:15 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" returned: 0 in 0.431s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8fedba75-d76c-425f-8f14-a384246916e1_y_me_pardevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:49:15 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:15 devstack sudo[106359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 1G
Sep 25 18:49:15 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:15 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 1G" returned: 0 in 0.307s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Downloaded image 8fedba75-d76c-425f-8f14-a384246916e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/8fedba75-d76c-425f-8f14-a384246916e1', 'metadata': {}}])) to volume 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Temporary image 8fedba75-d76c-425f-8f14-a384246916e1 for user b6c38345159445dd8e46e3bcac049e65 is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Marking volume 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Copying metadata from image 8fedba75-d76c-425f-8f14-a384246916e1 to 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Creating volume glance metadata for volume 9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 backed by image 8fedba75-d76c-425f-8f14-a384246916e1 with: {'image_id': '8fedba75-d76c-425f-8f14-a384246916e1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '91f2dec1556ac86b9d679e1a1859464e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932fa08e-8faa-439a-bb96-49b415a4020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6', 'volume_size': 1, 'image_id': '8fedba75-d76c-425f-8f14-a384246916e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fedba75-d76c-425f-8f14-a384246916e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91f2dec1556ac86b9d679e1a1859464e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '31c1cd2cdba34fcdb898906d5e4f89f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '306f12b0e254450a15442adf1877c1c3db4df42654ee231cb8fe48b7d24ee43824723e56b043d2d9ff77bd1f23aa8b2a246eb68f65aebeccc7a03024c08e41e6', 'id': '8fedba75-d76c-425f-8f14-a384246916e1', 'created_at': datetime.datetime(2026, 9, 25, 16, 49, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 49, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fedba75-d76c-425f-8f14-a384246916e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb8323080>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cfbc77-7fb5-412b-b3b5-0688e4997c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:15 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Volume volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 (9195b6d7-f06c-4d0b-96e6-35004a8d1eb6): created successfully
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cfbc77-7fb5-412b-b3b5-0688e4997c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:15 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Flow 'volume_create_manager' (29e32e66-879e-4a6d-90c4-0beb07b45ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-79c8a2a3-7c68-410c-a037-958d79dcbf9b tempest-VolumeImageDependencyTests-1578517230 None] Created volume successfully.
Sep 25 18:49:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Acquiring lock "cinder-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Lock "cinder-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Acquiring lock "cinder-quobyte-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Lock "cinder-quobyte-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:16 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6d444d-2a4c-474e-bc61-e582a6ab6044]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:16 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6
Sep 25 18:49:16 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:17 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" returned: 0 in 0.352s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:17 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6
Sep 25 18:49:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:17 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Lock "cinder-quobyte-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6" released by "delete_volume" :: held 0.644s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Created reservations ['04899de2-d3be-4a01-b4b9-56fb96b377f4', '5ac84f50-c3e1-4b01-8e00-e684188836f4', '45f54271-f2e3-48d7-9e63-650f0440d4ba', 'b140387d-096f-41a4-9684-6b9558f88ad8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:17 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:17 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:17 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Deleted volume successfully.
Sep 25 18:49:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e7a09e3-672d-4d32-b988-4780d1f62aaa tempest-VolumeImageDependencyTests-1578517230 None] Lock "cinder-9195b6d7-f06c-4d0b-96e6-35004a8d1eb6-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (322566ce-480c-4106-bde7-978b1f26fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ae30c4-211c-4af4-a9af-66cef2772a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ae30c4-211c-4af4-a9af-66cef2772a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160365925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc29970-7416-4e55-bd4e-b219b7e4e69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:21Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de6ffe0-f03d-4103-9016-7bf3c31ed059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de6ffe0-f03d-4103-9016-7bf3c31ed059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1354729-3e1f-4377-adf5-8f14164ebfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1354729-3e1f-4377-adf5-8f14164ebfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc29970-7416-4e55-bd4e-b219b7e4e69a', 'volume_name': 'volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b61fec-f0b9-45be-95cb-ba843ff950b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b61fec-f0b9-45be-95cb-ba843ff950b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9840ccc9-3bef-431b-abc3-aa9e0a67dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:21 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Volume 1cc29970-7416-4e55-bd4e-b219b7e4e69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a', 'volume_size': 1}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160365925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc29970-7416-4e55-bd4e-b219b7e4e69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:21Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Creating volume 1cc29970-7416-4e55-bd4e-b219b7e4e69a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:21 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:21 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a 1073741824
Sep 25 18:49:21 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:21 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a 1073741824" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:21 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a
Sep 25 18:49:21 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:21 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a" returned: 0 in 0.236s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9840ccc9-3bef-431b-abc3-aa9e0a67dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a80252d-61eb-4de2-b830-5f4eb7ce0597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:21 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Volume volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a (1cc29970-7416-4e55-bd4e-b219b7e4e69a): created successfully
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a80252d-61eb-4de2-b830-5f4eb7ce0597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (322566ce-480c-4106-bde7-978b1f26fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a1de689b-34ee-49c2-b330-1b32b8e4e0be tempest-ProjectReaderTests-1746289410 None] Created volume successfully.
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-1cc29970-7416-4e55-bd4e-b219b7e4e69a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Lock "cinder-1cc29970-7416-4e55-bd4e-b219b7e4e69a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-quobyte-1cc29970-7416-4e55-bd4e-b219b7e4e69a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-1cc29970-7416-4e55-bd4e-b219b7e4e69a" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e333a62f-fe4b-4871-9647-257af7432da9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:22 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a
Sep 25 18:49:22 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:22 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a" returned: 0 in 0.354s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:22 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a
Sep 25 18:49:22 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:22 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1cc29970-7416-4e55-bd4e-b219b7e4e69a" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-1cc29970-7416-4e55-bd4e-b219b7e4e69a" released by "delete_volume" :: held 0.635s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Created reservations ['9fd23ad7-a40b-417f-ac83-aadd22b49149', '3a644e85-2b07-43ee-a1fa-b373236aab5d', 'e4581dd3-2e98-4aac-a01b-e34d28635e9d', 'cfda1ba7-7f4e-4cb7-a338-96c0ef7bc253'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:23 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:23 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:23 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Deleted volume successfully.
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4eccf3e4-b32b-4a9c-a4b0-1cd1b6e6566b tempest-ProjectReaderTests-1746289410 None] Lock "cinder-1cc29970-7416-4e55-bd4e-b219b7e4e69a-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (bd06a4fa-996b-4052-986c-9b6236620f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f469c98-d0b2-4d95-b69f-fd4ea72263e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f469c98-d0b2-4d95-b69f-fd4ea72263e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18039047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a33f56-e167-4f2f-8d35-d03300efcc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:24Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0b0a89-cd22-427b-9f9a-1130effec622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0b0a89-cd22-427b-9f9a-1130effec622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c7b12b-26de-4d7b-be70-1729d6a60083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c7b12b-26de-4d7b-be70-1729d6a60083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a33f56-e167-4f2f-8d35-d03300efcc32', 'volume_name': 'volume-e7a33f56-e167-4f2f-8d35-d03300efcc32', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e362cc-cba2-4d81-9a35-c93f251057b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e362cc-cba2-4d81-9a35-c93f251057b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266947bd-1c4c-4a41-942c-f1a00c2d9734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:23 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Volume e7a33f56-e167-4f2f-8d35-d03300efcc32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a33f56-e167-4f2f-8d35-d03300efcc32', 'volume_size': 1}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18039047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a33f56-e167-4f2f-8d35-d03300efcc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:24Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Creating volume e7a33f56-e167-4f2f-8d35-d03300efcc32 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:23 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:49:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:23 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 1073741824
Sep 25 18:49:23 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:24 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 1073741824" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:24 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32
Sep 25 18:49:24 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:24 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32" returned: 0 in 0.242s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266947bd-1c4c-4a41-942c-f1a00c2d9734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a33f56-e167-4f2f-8d35-d03300efcc32', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203246fe-aa8d-42b9-b0c1-dcd5abf946e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:24 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Volume volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 (e7a33f56-e167-4f2f-8d35-d03300efcc32): created successfully
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203246fe-aa8d-42b9-b0c1-dcd5abf946e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (bd06a4fa-996b-4052-986c-9b6236620f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-73829b81-15f6-44d1-9236-95fea3d5bfdc tempest-ProjectReaderTests-1746289410 None] Created volume successfully.
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-e7a33f56-e167-4f2f-8d35-d03300efcc32-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Lock "cinder-e7a33f56-e167-4f2f-8d35-d03300efcc32-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-quobyte-e7a33f56-e167-4f2f-8d35-d03300efcc32" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-e7a33f56-e167-4f2f-8d35-d03300efcc32" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e9ac3-1e78-4443-a8ae-befddb835a7d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:25 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32
Sep 25 18:49:25 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:25 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:25 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32
Sep 25 18:49:25 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:25 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e7a33f56-e167-4f2f-8d35-d03300efcc32" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-e7a33f56-e167-4f2f-8d35-d03300efcc32" released by "delete_volume" :: held 0.643s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Created reservations ['5b91f24a-24f6-4bc6-b5f2-6f6d4a1cac52', '03f7012d-e7de-489b-8dc1-080eb5e5fab1', '4dba0456-a3d6-4caf-ace1-0820d0bdca1b', '38a52366-dbdc-4fd6-873f-8404e61673ef'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:25 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:25 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:25 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:25 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Deleted volume successfully.
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-208e4b5e-7562-48f0-a20a-5f30badad01c tempest-ProjectReaderTests-1746289410 None] Lock "cinder-e7a33f56-e167-4f2f-8d35-d03300efcc32-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (51284c8b-d976-4569-ab9b-5849a377e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856f9306-c886-447e-9b91-13da5dad41a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856f9306-c886-447e-9b91-13da5dad41a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764891175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e89af2-868d-43ef-88c6-c07486714c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:26Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2641320e-c078-4bce-8379-6d1edbd00c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2641320e-c078-4bce-8379-6d1edbd00c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1980ad-d575-41b8-9426-efa7ed06fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1980ad-d575-41b8-9426-efa7ed06fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e89af2-868d-43ef-88c6-c07486714c4a', 'volume_name': 'volume-49e89af2-868d-43ef-88c6-c07486714c4a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cfd7ea-0630-4b05-bb0f-98894b99596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cfd7ea-0630-4b05-bb0f-98894b99596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b4811a-9360-4c32-8117-246a6224f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:26 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Volume 49e89af2-868d-43ef-88c6-c07486714c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e89af2-868d-43ef-88c6-c07486714c4a', 'volume_size': 1}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1764891175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e89af2-868d-43ef-88c6-c07486714c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:26Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Creating volume 49e89af2-868d-43ef-88c6-c07486714c4a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:26 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:26 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a 1073741824
Sep 25 18:49:26 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:26 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a 1073741824" returned: 0 in 0.406s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:27 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a
Sep 25 18:49:27 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:27 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b4811a-9360-4c32-8117-246a6224f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e89af2-868d-43ef-88c6-c07486714c4a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf34c95a-8b78-415f-af02-81390a7bc9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:27 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Volume volume-49e89af2-868d-43ef-88c6-c07486714c4a (49e89af2-868d-43ef-88c6-c07486714c4a): created successfully
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf34c95a-8b78-415f-af02-81390a7bc9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (51284c8b-d976-4569-ab9b-5849a377e941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:27 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c368a3e0-d734-4caa-99b5-ed6a4c58d9ff tempest-ProjectReaderTests-1746289410 None] Created volume successfully.
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-49e89af2-868d-43ef-88c6-c07486714c4a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Lock "cinder-49e89af2-868d-43ef-88c6-c07486714c4a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-quobyte-49e89af2-868d-43ef-88c6-c07486714c4a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-49e89af2-868d-43ef-88c6-c07486714c4a" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f5fb9-f064-4b95-a37c-b50443b3e91b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:27 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a
Sep 25 18:49:27 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:28 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a" returned: 0 in 0.354s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:28 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a
Sep 25 18:49:28 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:28 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-49e89af2-868d-43ef-88c6-c07486714c4a" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-49e89af2-868d-43ef-88c6-c07486714c4a" released by "delete_volume" :: held 0.638s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Created reservations ['05639417-b591-46d3-8a70-4b3ba8b7b1b5', '576121d3-83fb-4970-a545-d7e5a96c9030', '21783b9a-06fc-43cb-ab24-6f2d3f65355f', '4e7583ea-3505-4d8e-aedb-7981d269c0e6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:28 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:28 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:28 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Deleted volume successfully.
Sep 25 18:49:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0beb64e3-04b2-43bd-a8ef-d4241a0816c7 tempest-ProjectReaderTests-1746289410 None] Lock "cinder-49e89af2-868d-43ef-88c6-c07486714c4a-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (d0af54a9-593b-42f5-a889-b313a670a442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968ed9a6-3ab1-46ae-b0e3-2352cc364f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968ed9a6-3ab1-46ae-b0e3-2352cc364f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804360641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8325273-93cb-42ca-88e1-57ac50aa819f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:29Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad84837-9bc7-4066-9a3b-e7b8f3dff211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad84837-9bc7-4066-9a3b-e7b8f3dff211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff35a2d2-bea5-4615-8183-a3014af51547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff35a2d2-bea5-4615-8183-a3014af51547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8325273-93cb-42ca-88e1-57ac50aa819f', 'volume_name': 'volume-a8325273-93cb-42ca-88e1-57ac50aa819f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4125a490-248b-4a67-b5d8-f265db525fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4125a490-248b-4a67-b5d8-f265db525fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b83e8-fb48-4ee0-9d9b-03764d8d89d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Volume a8325273-93cb-42ca-88e1-57ac50aa819f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8325273-93cb-42ca-88e1-57ac50aa819f', 'volume_size': 1}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804360641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8325273-93cb-42ca-88e1-57ac50aa819f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c555ef4be3415b993fd280b11136c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:29Z,use_quota=True,user_id='458a0157efe1457b8cab4775304c8235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Creating volume a8325273-93cb-42ca-88e1-57ac50aa819f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:29 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:29 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f 1073741824
Sep 25 18:49:29 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:29 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f 1073741824" returned: 0 in 0.409s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:29 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f
Sep 25 18:49:29 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:29 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b83e8-fb48-4ee0-9d9b-03764d8d89d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8325273-93cb-42ca-88e1-57ac50aa819f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66174a66-e98a-4451-8d47-4e4d889aa645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Volume volume-a8325273-93cb-42ca-88e1-57ac50aa819f (a8325273-93cb-42ca-88e1-57ac50aa819f): created successfully
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66174a66-e98a-4451-8d47-4e4d889aa645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Flow 'volume_create_manager' (d0af54a9-593b-42f5-a889-b313a670a442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b78353fe-7736-4fe9-a949-b1beaee5662f tempest-ProjectReaderTests-1746289410 None] Created volume successfully.
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-a8325273-93cb-42ca-88e1-57ac50aa819f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Lock "cinder-a8325273-93cb-42ca-88e1-57ac50aa819f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Acquiring lock "cinder-quobyte-a8325273-93cb-42ca-88e1-57ac50aa819f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-a8325273-93cb-42ca-88e1-57ac50aa819f" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e43f47c-cc62-4c96-8b19-f0546e6141a5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:30 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f
Sep 25 18:49:30 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:30 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f" returned: 0 in 0.344s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:30 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f
Sep 25 18:49:30 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:30 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a8325273-93cb-42ca-88e1-57ac50aa819f" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Lock "cinder-quobyte-a8325273-93cb-42ca-88e1-57ac50aa819f" released by "delete_volume" :: held 0.626s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Created reservations ['aa7843e2-5ddb-4d30-aad6-6b0d62e2fd61', '7b27299e-9f23-44df-a6ac-f9bdbfeb3697', 'fc2dca74-79df-4b0b-b87d-3ec3842ac2da', 'bef5cbba-b106-4aed-85f1-3be2da129fa3'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:30 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:30 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:31 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.233s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:31 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Deleted volume successfully.
Sep 25 18:49:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7eb32a5-6a99-4cf3-9dfe-b683c3db110a tempest-ProjectReaderTests-1746289410 None] Lock "cinder-a8325273-93cb-42ca-88e1-57ac50aa819f-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:49:40 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=90,cinder:INSERT=39,cinder:UPDATE=133,cinder:DELETE=10 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:49:41 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=127,cinder:DELETE=13,cinder:SELECT=94,cinder:INSERT=30 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:44 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:49:44 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:44 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:49:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Flow 'volume_create_manager' (d7f61b76-de7c-46f4-a846-9712b34c4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051cf448-37e2-45d6-9437-3fbe11c5c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (051cf448-37e2-45d6-9437-3fbe11c5c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1594528482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6138cf4e-bde8-42c8-ad9e-17f321b9ce44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0860f961db6464c975a5f8b4f3e0a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:53Z,use_quota=True,user_id='0254c676b9bb4cf7af9df557fe18ce02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea4cd67-475f-4890-8c21-6bec9ccb15e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea4cd67-475f-4890-8c21-6bec9ccb15e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768225e8-9ad3-4a87-8025-1da1a82c57cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768225e8-9ad3-4a87-8025-1da1a82c57cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6138cf4e-bde8-42c8-ad9e-17f321b9ce44', 'volume_name': 'volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80479eb1-8208-4ae2-8602-5963b3f84c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80479eb1-8208-4ae2-8602-5963b3f84c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037f304-9d61-4fc3-a92c-bb957aae750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Volume 6138cf4e-bde8-42c8-ad9e-17f321b9ce44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44', 'volume_size': 1}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1594528482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6138cf4e-bde8-42c8-ad9e-17f321b9ce44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0860f961db6464c975a5f8b4f3e0a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:53Z,use_quota=True,user_id='0254c676b9bb4cf7af9df557fe18ce02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Creating volume 6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:52 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:49:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:52 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 1073741824
Sep 25 18:49:52 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:53 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 1073741824" returned: 0 in 0.398s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:53 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44
Sep 25 18:49:53 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:53 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037f304-9d61-4fc3-a92c-bb957aae750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af77cf2d-b0aa-48b0-bc68-c34adc8635f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Volume volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 (6138cf4e-bde8-42c8-ad9e-17f321b9ce44): created successfully
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af77cf2d-b0aa-48b0-bc68-c34adc8635f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Flow 'volume_create_manager' (d7f61b76-de7c-46f4-a846-9712b34c4adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a703848d-8a9e-48ba-af6e-fb0091b0cbfa tempest-SnapshotDependencyTests-560060930 None] Created volume successfully.
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Creating offline snapshot 3220c5b7-4c6b-40ac-a9fe-067ac702c52a of volume 6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d3aec6-21b9-4d38-956a-a45ca50e9b82]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:53 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44
Sep 25 18:49:53 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:54 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" returned: 0 in 0.356s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:54 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a 1G
Sep 25 18:49:54 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:54 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a 1G" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:54 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a
Sep 25 18:49:54 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:54 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:54 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a is being set with open permissions: ugo+rw
Sep 25 18:49:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:54 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a
Sep 25 18:49:54 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:55 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:55 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info
Sep 25 18:49:55 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:55 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:55 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info is being set with open permissions: ugo+rw
Sep 25 18:49:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:55 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info
Sep 25 18:49:55 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:55 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.info" returned: 0 in 0.237s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-600ba458-4db4-4ec8-af79-f73a7240443a tempest-SnapshotDependencyTests-560060930 None] Create snapshot completed successfully
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Flow 'volume_create_manager' (6f2f392e-18bc-4958-a628-7df46806212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cfa5dd-b7c7-4139-bbef-8427c08fb68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cfa5dd-b7c7-4139-bbef-8427c08fb68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67d8080e-2eb0-4260-9bba-9aa27fd8a29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0860f961db6464c975a5f8b4f3e0a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3220c5b7-4c6b-40ac-a9fe-067ac702c52a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:49:56Z,use_quota=True,user_id='0254c676b9bb4cf7af9df557fe18ce02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c8fbec-ca21-4485-bd4e-e0a2182e8fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c8fbec-ca21-4485-bd4e-e0a2182e8fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b7bec7-7ba6-46aa-aa54-3d67a6e3befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b7bec7-7ba6-46aa-aa54-3d67a6e3befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67d8080e-2eb0-4260-9bba-9aa27fd8a29e', 'volume_name': 'volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e', 'volume_size': 1, 'snapshot_id': '3220c5b7-4c6b-40ac-a9fe-067ac702c52a'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f508977-4a59-4d24-99b6-cd91c8c77f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f508977-4a59-4d24-99b6-cd91c8c77f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82644fe0-d5a8-4432-a732-980cf18623e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:49:56 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Volume 67d8080e-2eb0-4260-9bba-9aa27fd8a29e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e', 'volume_size': 1, 'snapshot_id': '3220c5b7-4c6b-40ac-a9fe-067ac702c52a'}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-quobyte-3220c5b7-4c6b-40ac-a9fe-067ac702c52a-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-3220c5b7-4c6b-40ac-a9fe-067ac702c52a-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Creating volume 67d8080e-2eb0-4260-9bba-9aa27fd8a29e from snapshot 3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-quobyte-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] snapshot: 3220c5b7-4c6b-40ac-a9fe-067ac702c52a, volume: 67d8080e-2eb0-4260-9bba-9aa27fd8a29e,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8113af4e-a48f-4fdd-958f-df1c49968823]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:56 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a
Sep 25 18:49:56 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:57 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f99fb-d2ff-4512-9683-a0d9e9710c9d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:57 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44
Sep 25 18:49:57 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:49:57 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" returned: 0 in 0.347s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:49:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:49:57 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e
Sep 25 18:49:57 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:03 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" returned: 0 in 5.753s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:50:03 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Converted 1024.00 MB image at 177.95 MB/s
Sep 25 18:50:03 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e is being set with open permissions: ugo+rw
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:03 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e
Sep 25 18:50:03 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:03 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" released by "_copy_volume_from_snapshot" :: held 6.777s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-3220c5b7-4c6b-40ac-a9fe-067ac702c52a-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" released by "_create_volume_from_snapshot" :: held 6.835s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.850s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82644fe0-d5a8-4432-a732-980cf18623e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e', 'volume_size': 1, 'snapshot_id': '3220c5b7-4c6b-40ac-a9fe-067ac702c52a'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bb31e1-6b77-4061-9a8a-82d6a65d8faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Volume volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e (67d8080e-2eb0-4260-9bba-9aa27fd8a29e): created successfully
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bb31e1-6b77-4061-9a8a-82d6a65d8faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Flow 'volume_create_manager' (6f2f392e-18bc-4958-a628-7df46806212e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-38362580-6a76-47ac-a03e-815266c1fce7 tempest-SnapshotDependencyTests-560060930 None] Created volume successfully.
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-3220c5b7-4c6b-40ac-a9fe-067ac702c52a-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-3220c5b7-4c6b-40ac-a9fe-067ac702c52a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-quobyte-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-quobyte-3220c5b7-4c6b-40ac-a9fe-067ac702c52a" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-3220c5b7-4c6b-40ac-a9fe-067ac702c52a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Deleting offline snapshot 3220c5b7-4c6b-40ac-a9fe-067ac702c52a of volume 6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] snapshot_file for this snap is: volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd0dbb6-ad4e-43b5-b566-a60e15f2ff09]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:04 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a
Sep 25 18:50:04 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:04 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a" returned: 0 in 0.356s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf828ef4-3c1d-486f-958d-a805ac00b9f3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:04 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44
Sep 25 18:50:04 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:04 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" returned: 0 in 0.511s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:05 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a
Sep 25 18:50:05 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:05 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a" returned: 0 in 0.322s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:05 devstack sudo[106586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a
Sep 25 18:50:05 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:05 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44.3220c5b7-4c6b-40ac-a9fe-067ac702c52a" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-3220c5b7-4c6b-40ac-a9fe-067ac702c52a" released by "_delete_snapshot" :: held 1.535s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" released by "delete_snapshot" :: held 1.557s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Created reservations ['244dcf76-2abd-4480-af40-f0e1070c2435', 'd7bf0fdd-afa1-4235-a5ad-027e4626dd0b', '32124ce3-943a-431d-9d93-a8878f6148fa', '6466cd83-5e10-486c-9ef3-ee3938e861a5'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Delete snapshot completed successfully.
Sep 25 18:50:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-155d1b64-2bb9-4bc1-9e68-ad4977faa8b0 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-3220c5b7-4c6b-40ac-a9fe-067ac702c52a-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-6138cf4e-bde8-42c8-ad9e-17f321b9ce44-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-6138cf4e-bde8-42c8-ad9e-17f321b9ce44-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-quobyte-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" acquired by "delete_volume" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea5a1a-ada7-4cf6-9f06-17f7ea959c74]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:06 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44
Sep 25 18:50:06 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:06 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" returned: 0 in 0.352s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:06 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44
Sep 25 18:50:06 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:06 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" returned: 0 in 0.238s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-6138cf4e-bde8-42c8-ad9e-17f321b9ce44" released by "delete_volume" :: held 0.646s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Created reservations ['eb43eb27-e3d4-48ca-b0a8-2a4c581ff337', 'f10f86bb-dabb-4780-8b2d-a860a0372324', '3d842851-a3b1-4c85-ac0e-224a6c57d67e', '13faa0c7-09a3-48d1-b609-f2894979faa6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:06 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:06 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:07 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.241s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Deleted volume successfully.
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-17e84d55-6e88-429f-9408-950934e4f646 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-6138cf4e-bde8-42c8-ad9e-17f321b9ce44-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-67d8080e-2eb0-4260-9bba-9aa27fd8a29e-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-67d8080e-2eb0-4260-9bba-9aa27fd8a29e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "cinder-quobyte-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" acquired by "delete_volume" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7e560-7ef2-4a0e-89d5-ac7fba28d430]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:07 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e
Sep 25 18:50:07 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:07 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:07 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e
Sep 25 18:50:07 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:08 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-quobyte-67d8080e-2eb0-4260-9bba-9aa27fd8a29e" released by "delete_volume" :: held 0.642s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Created reservations ['933381d6-5903-4e0f-aaca-30474a3c7ee3', '20d44d32-13bd-4e08-936d-8657cf48c298', '18850bdd-db98-4b28-9818-19ccc0775e48', 'fdfca0a3-bfe4-4f66-86e1-83da20092b23'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:08 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:08 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:08 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Deleted volume successfully.
Sep 25 18:50:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f11ff2d7-334d-4b52-962e-7d33f43ca1b4 tempest-SnapshotDependencyTests-560060930 None] Lock "cinder-67d8080e-2eb0-4260-9bba-9aa27fd8a29e-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:18 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=23,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=8 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:50:18 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (0b9bb396-e0f4-4395-a22e-89ba50a2c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aa7af4-9768-4289-b28e-0a048ab643fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aa7af4-9768-4289-b28e-0a048ab643fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120356872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355846d9-7500-42cc-be7d-7b9ed63ef7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:29Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd5a4f0-44c8-4876-bd18-b40ac7b5c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd5a4f0-44c8-4876-bd18-b40ac7b5c68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17258976-25a0-4cd5-a962-f63e54de917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17258976-25a0-4cd5-a962-f63e54de917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355846d9-7500-42cc-be7d-7b9ed63ef7b5', 'volume_name': 'volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298ad0eb-2d3b-4a07-96e4-2e00e2f9ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298ad0eb-2d3b-4a07-96e4-2e00e2f9ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a111a8-32d7-4bd9-965d-eea40df1d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume 355846d9-7500-42cc-be7d-7b9ed63ef7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5', 'volume_size': 1}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120356872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355846d9-7500-42cc-be7d-7b9ed63ef7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:29Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating volume 355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:29 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:29 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 1073741824
Sep 25 18:50:29 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (6f7dcd1d-7c0d-46cf-af09-534c72a8197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b15d729-b3fb-4230-a983-04c86131d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b15d729-b3fb-4230-a983-04c86131d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-788594301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acae08f7-ce5b-4389-bd19-65c4b384e407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:29Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70af885-893c-4154-9e54-bc8e3c3844f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70af885-893c-4154-9e54-bc8e3c3844f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1a6f90-2919-4b9e-a059-904e207db632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1a6f90-2919-4b9e-a059-904e207db632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acae08f7-ce5b-4389-bd19-65c4b384e407', 'volume_name': 'volume-acae08f7-ce5b-4389-bd19-65c4b384e407', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d34dc3-83e6-4c80-84ca-55de84e583c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d34dc3-83e6-4c80-84ca-55de84e583c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773859c9-9f17-46f8-9a04-fedb5f1d038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume acae08f7-ce5b-4389-bd19-65c4b384e407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acae08f7-ce5b-4389-bd19-65c4b384e407', 'volume_size': 1}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:29 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 1073741824" returned: 0 in 0.511s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:29 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5
Sep 25 18:50:29 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:30 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5" returned: 0 in 0.286s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-788594301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acae08f7-ce5b-4389-bd19-65c4b384e407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:29Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Creating volume acae08f7-ce5b-4389-bd19-65c4b384e407 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:30 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a111a8-32d7-4bd9-965d-eea40df1d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6da64f-de67-46d0-9bb1-55a097a94b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:30 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407 1073741824
Sep 25 18:50:30 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:30 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 (355846d9-7500-42cc-be7d-7b9ed63ef7b5): created successfully
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6da64f-de67-46d0-9bb1-55a097a94b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (0b9bb396-e0f4-4395-a22e-89ba50a2c739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8bc83045-c832-419d-945f-ed4894dfc963 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created volume successfully.
Sep 25 18:50:30 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407 1073741824" returned: 0 in 0.549s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:30 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407
Sep 25 18:50:30 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:31 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407" returned: 0 in 0.349s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773859c9-9f17-46f8-9a04-fedb5f1d038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acae08f7-ce5b-4389-bd19-65c4b384e407', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383fb08b-10d5-413a-9172-0551dbbe8efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:31 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume volume-acae08f7-ce5b-4389-bd19-65c4b384e407 (acae08f7-ce5b-4389-bd19-65c4b384e407): created successfully
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383fb08b-10d5-413a-9172-0551dbbe8efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (6f7dcd1d-7c0d-46cf-af09-534c72a8197d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:31 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7ffe76bb-04a6-45fa-9f1a-991622335d85 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created volume successfully.
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating offline snapshot 09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 of volume 355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5789f45f-dbdd-4c2e-b8a2-68b3149724cc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:31 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5
Sep 25 18:50:31 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Flow 'volume_create_manager' (4eecae2a-dfc1-4a86-91f9-21fb763a32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc83fb2-4741-44db-9903-e2d67e340f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc83fb2-4741-44db-9903-e2d67e340f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8243319c-8b18-4bee-8ffe-8ce1dd29c367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6c767649c14cd8843ea8d9c1991fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:32Z,use_quota=True,user_id='9eadd18bafe545b6b5cf860c070fe4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90876c13-c4ae-47c6-bfe2-411d21cd2fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90876c13-c4ae-47c6-bfe2-411d21cd2fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c065f7-c820-47c3-8880-d00fdd3dbcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:50:31 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5" returned: 0 in 0.441s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:31 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 1G
Sep 25 18:50:31 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c065f7-c820-47c3-8880-d00fdd3dbcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8243319c-8b18-4bee-8ffe-8ce1dd29c367', 'volume_name': 'volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367', 'volume_size': 1, 'image_id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b3e459f902414eb2acd26899ba403da5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce6c767649c14cd8843ea8d9c1991fbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd4bdd93bd3653818d669f2001fab983fb69eb9879a093760ed3e9068c213a5c310faf5968b057db580e52c8a38541488278e779e2398327f3bb1865382cda07', 'id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'created_at': datetime.datetime(2026, 9, 25, 16, 50, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb827ab40>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444dc27b-2450-4a86-9d4a-3e9ad4502b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444dc27b-2450-4a86-9d4a-3e9ad4502b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d4ca78-97a6-4e81-a527-90dabf19da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:32 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Volume 8243319c-8b18-4bee-8ffe-8ce1dd29c367: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367', 'volume_size': 1, 'image_id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b3e459f902414eb2acd26899ba403da5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce6c767649c14cd8843ea8d9c1991fbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd4bdd93bd3653818d669f2001fab983fb69eb9879a093760ed3e9068c213a5c310faf5968b057db580e52c8a38541488278e779e2398327f3bb1865382cda07', 'id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'created_at': datetime.datetime(2026, 9, 25, 16, 50, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb827ab40>}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Trying to clone 8243319c-8b18-4bee-8ffe-8ce1dd29c367 from image c7cdb647-0edc-4923-8da5-c0c0876eea3f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:50:32 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64f5ef-c83f-4240-9392-ac721a421ed9]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:32 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 1G" returned: 0 in 0.585s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:32 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2
Sep 25 18:50:32 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:32 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD
Sep 25 18:50:32 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:32 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:32 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" returned: 0 in 0.450s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 is being set with open permissions: ugo+rw
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:32 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2
Sep 25 18:50:32 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:32 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD
Sep 25 18:50:32 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:32 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (e92541ff-aa13-4367-837a-079da4e4b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f7011-3602-4ef7-9132-f7fcf29f0dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f7011-3602-4ef7-9132-f7fcf29f0dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620685095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c10a50d-d559-4f67-ad53-5a60828132c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:33Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c313dfcc-d504-4255-82fc-97809de7d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c313dfcc-d504-4255-82fc-97809de7d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e12f36e-1108-43a1-a8a0-c79e33a6619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e12f36e-1108-43a1-a8a0-c79e33a6619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c10a50d-d559-4f67-ad53-5a60828132c8', 'volume_name': 'volume-2c10a50d-d559-4f67-ad53-5a60828132c8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8243a2-a019-4d97-b522-59ff8baea153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8243a2-a019-4d97-b522-59ff8baea153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8920e00-b7cc-4f08-b35b-084733c296b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume 2c10a50d-d559-4f67-ad53-5a60828132c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c10a50d-d559-4f67-ad53-5a60828132c8', 'volume_size': 1}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:33 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Temporary image c7cdb647-0edc-4923-8da5-c0c0876eea3f is fetched for user 9eadd18bafe545b6b5cf860c070fe4ca. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:33 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Flow 'volume_create_manager' (c91777cf-40ef-4002-baf3-8b8be565804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa79980-e204-4689-b6cd-db91a00add1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" returned: 0 in 0.414s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa79980-e204-4689-b6cd-db91a00add1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb74899-d16e-4972-a575-67c898f5f580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d085061e85b404089d8b5f3cef4c00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:33Z,use_quota=True,user_id='d8ffce476e284da4af7f30c0628a0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe93181-afa0-4b08-9c64-1419d60815d5),volume_type_id=5fe93181-afa0-4b08-9c64-1419d60815d5)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7617a510-5376-43ef-b3f0-ba00e4e434df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7617a510-5376-43ef-b3f0-ba00e4e434df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297758c1-03a8-4dff-a729-1fcb664f2944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.image.glance [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Creating Keystone auth plugin from conf {{(pid=86534) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac3dd4a-2075-4c88-9325-214277f26cde]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:33 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info
Sep 25 18:50:33 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:33 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD
Sep 25 18:50:33 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (37d6b6f4-097e-4c8c-88a4-f8f07cc8df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5d573a-44e2-43b7-9442-fdc5e321817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5d573a-44e2-43b7-9442-fdc5e321817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480896965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd06c0a-5294-471f-919a-f1edcbb49976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:33Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2126d7-020b-446f-a6de-db5abd5f8144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2126d7-020b-446f-a6de-db5abd5f8144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b81abf-7fe5-4e21-9763-c17676237feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b81abf-7fe5-4e21-9763-c17676237feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd06c0a-5294-471f-919a-f1edcbb49976', 'volume_name': 'volume-9dd06c0a-5294-471f-919a-f1edcbb49976', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f966ad95-4c15-4771-b160-e48f3566c797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f966ad95-4c15-4771-b160-e48f3566c797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aac1813-7321-4947-9187-804b0a5ecd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume 9dd06c0a-5294-471f-919a-f1edcbb49976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd06c0a-5294-471f-919a-f1edcbb49976', 'volume_size': 1}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297758c1-03a8-4dff-a729-1fcb664f2944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfb74899-d16e-4972-a575-67c898f5f580', 'volume_name': 'volume-dfb74899-d16e-4972-a575-67c898f5f580', 'volume_size': 1, 'image_id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dce226e-db54-4a19-9eee-2aad28a745e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eaf5821250645cf1b16da85c05e0a107', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d085061e85b404089d8b5f3cef4c00f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c706c53b7e18bcaabf96627ce11fc232ae8d744ca2a43feaacc5ead84317a666ba48ee12d201ccc39349e7d3cbff75d905abb7fb39070696d10c43d07cfee71', 'id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'created_at': datetime.datetime(2026, 9, 25, 16, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 50, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dce226e-db54-4a19-9eee-2aad28a745e1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7f019d0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defcfa04-fa04-4a8a-9042-602c7264fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defcfa04-fa04-4a8a-9042-602c7264fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0008df48-11e8-4ba5-aa1e-493eb99b5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:33 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Volume dfb74899-d16e-4972-a575-67c898f5f580: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfb74899-d16e-4972-a575-67c898f5f580', 'volume_size': 1, 'image_id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dce226e-db54-4a19-9eee-2aad28a745e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eaf5821250645cf1b16da85c05e0a107', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d085061e85b404089d8b5f3cef4c00f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c706c53b7e18bcaabf96627ce11fc232ae8d744ca2a43feaacc5ead84317a666ba48ee12d201ccc39349e7d3cbff75d905abb7fb39070696d10c43d07cfee71', 'id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'created_at': datetime.datetime(2026, 9, 25, 16, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 50, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dce226e-db54-4a19-9eee-2aad28a745e1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7f019d0>}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Trying to clone dfb74899-d16e-4972-a575-67c898f5f580 from image 6dce226e-db54-4a19-9eee-2aad28a745e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dce226e-db54-4a19-9eee-2aad28a745e1', 'metadata': {}}]). {{(pid=86534) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info" returned: 0 in 0.546s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:33 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info is being set with open permissions: ugo+rw
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:33 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info
Sep 25 18:50:33 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:33 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (0fc1b8e0-cef4-4c87-9d72-cc6c7c1635d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0296e138-e762-46e2-9686-88283804ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 25 18:50:34 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Image download 0.00 MB at 0.00 MB/s
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0296e138-e762-46e2-9686-88283804ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498729991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9bae6c-e3f5-4b54-8125-394264df1db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:34Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6255b9a6-8cc9-4aef-9c52-007fc91d4298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD
Sep 25 18:50:34 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6255b9a6-8cc9-4aef-9c52-007fc91d4298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8994e045-21ca-4b5f-88a2-7792146276e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8994e045-21ca-4b5f-88a2-7792146276e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9bae6c-e3f5-4b54-8125-394264df1db9', 'volume_name': 'volume-6a9bae6c-e3f5-4b54-8125-394264df1db9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f62b78-d432-4163-bec8-543fb95f0b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f62b78-d432-4163-bec8-543fb95f0b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bb4907-5f29-4fd8-95fe-69a86ab87fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume 6a9bae6c-e3f5-4b54-8125-394264df1db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9bae6c-e3f5-4b54-8125-394264df1db9', 'volume_size': 1}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (a92103e9-261d-4622-adee-5c2839831283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:34 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091e8547-2671-44a3-94c9-e606ea5ae2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8d9a2-adf1-4b08-b000-dc7953f48ba8]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.info" returned: 0 in 0.474s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620685095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c10a50d-d559-4f67-ad53-5a60828132c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:33Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Creating volume 2c10a50d-d559-4f67-ad53-5a60828132c8 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:34 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (091e8547-2671-44a3-94c9-e606ea5ae2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844120631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63f24e3-ef96-4c7d-80b8-5924403e4db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:34Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087dc5de-9c1a-4f87-b2e9-a02479d3d028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087dc5de-9c1a-4f87-b2e9-a02479d3d028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac05073-2efb-42ba-ae3c-737f0e053db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8 1073741824
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac05073-2efb-42ba-ae3c-737f0e053db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63f24e3-ef96-4c7d-80b8-5924403e4db3', 'volume_name': 'volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c08300c-4d73-4f33-ad37-aad0c4a128ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c08300c-4d73-4f33-ad37-aad0c4a128ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc238d27-93cd-4302-9971-7c6fae07ceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume a63f24e3-ef96-4c7d-80b8-5924403e4db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3', 'volume_size': 1}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD" returned: 1 in 0.613s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:34 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-65caf6ea-f3b7-4e17-85c8-cc092212353d tempest-CreateVolumesFromSnapshotTest-999565237 None] Create snapshot completed successfully
Sep 25 18:50:34 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD
Sep 25 18:50:34 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (70852832-fade-4eee-a1f5-66637b525bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5e45e8-0c7f-46fc-a23d-51221947cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5e45e8-0c7f-46fc-a23d-51221947cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378154977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6743eed5-5bc1-4dc8-955c-37bbea6cc5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:35Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3918d507-0ecd-442e-a339-4efe7e57d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3918d507-0ecd-442e-a339-4efe7e57d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ad81fb-c17a-4af5-a832-72b467bf50b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ad81fb-c17a-4af5-a832-72b467bf50b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6743eed5-5bc1-4dc8-955c-37bbea6cc5b6', 'volume_name': 'volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b37f655-8fef-49ed-bce1-dd2727cdfed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b37f655-8fef-49ed-bce1-dd2727cdfed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bda7b7-02cb-496c-80b3-8fc03af43635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume 6743eed5-5bc1-4dc8-955c-37bbea6cc5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6', 'volume_size': 1}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:34 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:34 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD
Sep 25 18:50:34 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:34 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8 1073741824" returned: 0 in 0.605s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:35 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8
Sep 25 18:50:35 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:35 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Temporary image 6dce226e-db54-4a19-9eee-2aad28a745e1 is fetched for user d8ffce476e284da4af7f30c0628a0cb1. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (463c22a1-7dd5-4998-85ea-0ae570b205c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da757c04-c5c1-4123-8e69-7b44088efcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da757c04-c5c1-4123-8e69-7b44088efcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-888046375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5414f24-014e-439f-a83a-8734c439ce01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:35Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afed3916-c99a-42e4-9b77-f617dea23f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afed3916-c99a-42e4-9b77-f617dea23f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa3eb14-ddda-4d75-9bfe-865b07dd0b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa3eb14-ddda-4d75-9bfe-865b07dd0b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5414f24-014e-439f-a83a-8734c439ce01', 'volume_name': 'volume-a5414f24-014e-439f-a83a-8734c439ce01', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f092afd-3335-45c1-84eb-0e51a5b2e865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f092afd-3335-45c1-84eb-0e51a5b2e865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16df30f-fa46-4f2f-8354-15f32ad136c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume a5414f24-014e-439f-a83a-8734c439ce01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5414f24-014e-439f-a83a-8734c439ce01', 'volume_size': 1}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8" returned: 0 in 0.322s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480896965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd06c0a-5294-471f-919a-f1edcbb49976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:33Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Creating volume 9dd06c0a-5294-471f-919a-f1edcbb49976 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:35 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8920e00-b7cc-4f08-b35b-084733c296b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c10a50d-d559-4f67-ad53-5a60828132c8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976 1073741824
Sep 25 18:50:35 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a227ee-8ed3-486c-947e-d12efabc98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6a004-c256-4de0-ad87-10a2580a6d8b]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:35 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume volume-2c10a50d-d559-4f67-ad53-5a60828132c8 (2c10a50d-d559-4f67-ad53-5a60828132c8): created successfully
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a227ee-8ed3-486c-947e-d12efabc98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (e92541ff-aa13-4367-837a-079da4e4b22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3cee7f9b-6d2d-4479-ac3f-d40a41c0d7cf tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created volume successfully.
Sep 25 18:50:35 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD
Sep 25 18:50:35 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (d724050c-ac73-4d13-bb0d-89edc585d933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a6a600-f871-404c-b890-5396d22c1676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a6a600-f871-404c-b890-5396d22c1676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835063831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e975e7-616d-4229-a229-52b1cc400713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:36Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e79b631-6274-4d6b-b6fa-655690961d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e79b631-6274-4d6b-b6fa-655690961d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80074c0d-944c-4729-8677-5a103c1fc6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80074c0d-944c-4729-8677-5a103c1fc6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e975e7-616d-4229-a229-52b1cc400713', 'volume_name': 'volume-22e975e7-616d-4229-a229-52b1cc400713', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff552fce-37d6-48cf-b33b-d5a6425606d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff552fce-37d6-48cf-b33b-d5a6425606d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053b72f3-f241-487d-9ee2-1889a714a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:35 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume 22e975e7-616d-4229-a229-52b1cc400713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e975e7-616d-4229-a229-52b1cc400713', 'volume_size': 1}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:35 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:36 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD
Sep 25 18:50:36 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:36 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976 1073741824" returned: 0 in 0.672s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:36 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976
Sep 25 18:50:36 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (bf94b030-2797-45ed-bd4d-9d2c12cb448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf09a18c-65fb-4b9b-9aa7-5a1b4a5a7ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf09a18c-65fb-4b9b-9aa7-5a1b4a5a7ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-915718996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d84d1b-6d80-4a61-8252-e929b3336a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:36Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c96e6c2-698b-4507-b119-60cc165060d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c96e6c2-698b-4507-b119-60cc165060d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02579f9-ec37-44ef-a54b-fcbd29824071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02579f9-ec37-44ef-a54b-fcbd29824071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d84d1b-6d80-4a61-8252-e929b3336a24', 'volume_name': 'volume-b5d84d1b-6d80-4a61-8252-e929b3336a24', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0603d49-899a-43a3-aba2-2b3d86426b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0603d49-899a-43a3-aba2-2b3d86426b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab17892e-575f-4882-858c-610c4e4b8211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume b5d84d1b-6d80-4a61-8252-e929b3336a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d84d1b-6d80-4a61-8252-e929b3336a24', 'volume_size': 1}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:36 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:36 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976" returned: 0 in 0.312s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.249s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-498729991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9bae6c-e3f5-4b54-8125-394264df1db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:34Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Creating volume 6a9bae6c-e3f5-4b54-8125-394264df1db9 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:36 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aac1813-7321-4947-9187-804b0a5ecd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd06c0a-5294-471f-919a-f1edcbb49976', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd77fdf-642f-4805-8068-a453a360f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 1073741824
Sep 25 18:50:36 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume volume-9dd06c0a-5294-471f-919a-f1edcbb49976 (9dd06c0a-5294-471f-919a-f1edcbb49976): created successfully
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd77fdf-642f-4805-8068-a453a360f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (37d6b6f4-097e-4c8c-88a4-f8f07cc8df06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c4ab3684-e41a-4d1b-acc7-58646e8b4308 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created volume successfully.
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (b5dfb4ea-a1f8-44b5-baaa-24008290ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f19d76-e8b2-49f8-b642-69051855fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f19d76-e8b2-49f8-b642-69051855fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314645601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf0d361-cae1-45bf-9495-c36fa321c5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:37Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4397a69-1358-4f51-a9a1-2137ea85ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4397a69-1358-4f51-a9a1-2137ea85ddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f39300-9398-4b80-8d54-a250c4273fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f39300-9398-4b80-8d54-a250c4273fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf0d361-cae1-45bf-9495-c36fa321c5b7', 'volume_name': 'volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f264455a-e8e1-4724-a382-119cbfd55ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f264455a-e8e1-4724-a382-119cbfd55ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e405a7-1acc-4ba3-af59-3f7426ffc84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume 3bf0d361-cae1-45bf-9495-c36fa321c5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7', 'volume_size': 1}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:36 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (3a73bed3-6ea2-4d40-82c4-f1dc69d6e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca109c9-0127-4222-8971-ee9f4af9a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 1073741824" returned: 0 in 0.543s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca109c9-0127-4222-8971-ee9f4af9a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1521671640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01409fb-a98c-4d10-9d26-3e68ad1c2b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:37Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cb22c9-1dd8-47db-95fa-7fb8dd7437e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cb22c9-1dd8-47db-95fa-7fb8dd7437e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c1f0f6-ffa7-4d05-be93-ed76542198dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c1f0f6-ffa7-4d05-be93-ed76542198dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01409fb-a98c-4d10-9d26-3e68ad1c2b89', 'volume_name': 'volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb179e2-1a2e-4b52-89fb-199fd9f26f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb179e2-1a2e-4b52-89fb-199fd9f26f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77fffe4-cfb9-4bf9-9c2e-5c17221603b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:37 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume b01409fb-a98c-4d10-9d26-3e68ad1c2b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89', 'volume_size': 1}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:37 devstack sudo[106799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9
Sep 25 18:50:37 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:37 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9" returned: 0 in 0.252s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.830s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844120631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63f24e3-ef96-4c7d-80b8-5924403e4db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:34Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Creating volume a63f24e3-ef96-4c7d-80b8-5924403e4db3 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:37 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bb4907-5f29-4fd8-95fe-69a86ab87fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9bae6c-e3f5-4b54-8125-394264df1db9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:37 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 1073741824
Sep 25 18:50:37 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce6f6ec-6dc5-4f0d-83fb-1415508f4427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:37 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 (6a9bae6c-e3f5-4b54-8125-394264df1db9): created successfully
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce6f6ec-6dc5-4f0d-83fb-1415508f4427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (0fc1b8e0-cef4-4c87-9d72-cc6c7c1635d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:37 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ec551b94-1369-40fe-85b5-7e7a473bc5d0 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created volume successfully.
Sep 25 18:50:37 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 1073741824" returned: 0 in 0.406s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:37 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3
Sep 25 18:50:37 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:37 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.522s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8243319c-8b18-4bee-8ffe-8ce1dd29c367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6c767649c14cd8843ea8d9c1991fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:32Z,use_quota=True,user_id='9eadd18bafe545b6b5cf860c070fe4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Creating volume 8243319c-8b18-4bee-8ffe-8ce1dd29c367 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:38 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc238d27-93cd-4302-9971-7c6fae07ceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:38 devstack sudo[106810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 1073741824
Sep 25 18:50:38 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38d52e5-1f8e-4a4d-87e4-fe2c84455df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 (a63f24e3-ef96-4c7d-80b8-5924403e4db3): created successfully
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38d52e5-1f8e-4a4d-87e4-fe2c84455df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (a92103e9-261d-4622-adee-5c2839831283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a5927fa9-6f17-4924-845d-d9802625cedc tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created volume successfully.
Sep 25 18:50:38 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 1073741824" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:38 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367
Sep 25 18:50:38 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:38 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367" returned: 0 in 0.239s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1378154977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6743eed5-5bc1-4dc8-955c-37bbea6cc5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba55df63b974b81a31b143ef696b854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:35Z,use_quota=True,user_id='d7aa172d12444f3f840819fb124d5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Creating volume 6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:38 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:38 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 1073741824
Sep 25 18:50:38 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Attempting download of c7cdb647-0edc-4923-8da5-c0c0876eea3f ((None, [{'url': 'file:///opt/stack/data/glance/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'metadata': {}}])) to volume 8243319c-8b18-4bee-8ffe-8ce1dd29c367. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[976bca03-e5a2-4e25-b983-578fe5da8aff]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:38 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh
Sep 25 18:50:38 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:39 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh" returned: 0 in 0.327s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:39 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 1073741824" returned: 0 in 0.488s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:39 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh
Sep 25 18:50:39 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:39 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6
Sep 25 18:50:39 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:39 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh" returned: 1 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7cdb647-0edc-4923-8da5-c0c0876eea3f_9d19jzbh' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab279166-7f91-4a79-bacb-3815447cd5c7]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:39 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6" returned: 0 in 0.250s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.144s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-888046375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5414f24-014e-439f-a83a-8734c439ce01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:35Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating volume a5414f24-014e-439f-a83a-8734c439ce01 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:39 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:39 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01 1073741824
Sep 25 18:50:39 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bda7b7-02cb-496c-80b3-8fc03af43635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57daaa3d-bad5-4d0d-896e-d79e48eccbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:39 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Volume volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 (6743eed5-5bc1-4dc8-955c-37bbea6cc5b6): created successfully
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57daaa3d-bad5-4d0d-896e-d79e48eccbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Flow 'volume_create_manager' (70852832-fade-4eee-a1f5-66637b525bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cf454496-1080-4902-ae64-8ecae178e248 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created volume successfully.
Sep 25 18:50:39 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD
Sep 25 18:50:39 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:39 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:39 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD
Sep 25 18:50:39 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:39 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01 1073741824" returned: 0 in 0.426s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01
Sep 25 18:50:40 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:40 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] c7cdb647-0edc-4923-8da5-c0c0876eea3f was raw, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367
Sep 25 18:50:40 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:40 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01" returned: 0 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.437s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1835063831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e975e7-616d-4229-a229-52b1cc400713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:36Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating volume 22e975e7-616d-4229-a229-52b1cc400713 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:40 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713 1073741824
Sep 25 18:50:40 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16df30f-fa46-4f2f-8354-15f32ad136c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5414f24-014e-439f-a83a-8734c439ce01', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87525123-7c76-4cd8-9a40-7518b3b38c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:40 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume volume-a5414f24-014e-439f-a83a-8734c439ce01 (a5414f24-014e-439f-a83a-8734c439ce01): created successfully
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87525123-7c76-4cd8-9a40-7518b3b38c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (463c22a1-7dd5-4998-85ea-0ae570b205c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-quobyte-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-afab9560-83ff-4423-bd02-db84961392d7 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created volume successfully.
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9cfd6-ac25-4b22-a482-477e5b1370db]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6
Sep 25 18:50:40 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:40 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367" returned: 0 in 0.526s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7cdb647-0edc-4923-8da5-c0c0876eea3f_rb2fkx19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:50:40 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 1G
Sep 25 18:50:40 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:40 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713 1073741824" returned: 0 in 0.507s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:40 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:40 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6
Sep 25 18:50:40 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:40 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713
Sep 25 18:50:40 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:41 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 1G" returned: 0 in 0.342s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Downloaded image c7cdb647-0edc-4923-8da5-c0c0876eea3f ((None, [{'url': 'file:///opt/stack/data/glance/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'metadata': {}}])) to volume 8243319c-8b18-4bee-8ffe-8ce1dd29c367 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Temporary image c7cdb647-0edc-4923-8da5-c0c0876eea3f for user 9eadd18bafe545b6b5cf860c070fe4ca is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Marking volume 8243319c-8b18-4bee-8ffe-8ce1dd29c367 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Copying metadata from image c7cdb647-0edc-4923-8da5-c0c0876eea3f to 8243319c-8b18-4bee-8ffe-8ce1dd29c367. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Creating volume glance metadata for volume 8243319c-8b18-4bee-8ffe-8ce1dd29c367 backed by image c7cdb647-0edc-4923-8da5-c0c0876eea3f with: {'image_id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b3e459f902414eb2acd26899ba403da5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d4ca78-97a6-4e81-a527-90dabf19da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367', 'volume_size': 1, 'image_id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b3e459f902414eb2acd26899ba403da5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce6c767649c14cd8843ea8d9c1991fbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cd4bdd93bd3653818d669f2001fab983fb69eb9879a093760ed3e9068c213a5c310faf5968b057db580e52c8a38541488278e779e2398327f3bb1865382cda07', 'id': 'c7cdb647-0edc-4923-8da5-c0c0876eea3f', 'created_at': datetime.datetime(2026, 9, 25, 16, 50, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 50, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7cdb647-0edc-4923-8da5-c0c0876eea3f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb827ab40>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db5905b-0a58-4e0b-8dcc-22eed94b67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:41 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:41 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.906s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-915718996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d84d1b-6d80-4a61-8252-e929b3336a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:36Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating volume b5d84d1b-6d80-4a61-8252-e929b3336a24 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:41 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Volume volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 (8243319c-8b18-4bee-8ffe-8ce1dd29c367): created successfully
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db5905b-0a58-4e0b-8dcc-22eed94b67b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Flow 'volume_create_manager' (4eecae2a-dfc1-4a86-91f9-21fb763a32bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:41 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 1073741824
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:41 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053b72f3-f241-487d-9ee2-1889a714a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e975e7-616d-4229-a229-52b1cc400713', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83805755-a925-4a01-b253-858c2713bd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c32d04df-bc4f-4459-954a-8c5b314506be tempest-VolumeImageDependencyTests-1424864210 None] Created volume successfully.
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6" released by "delete_volume" :: held 0.799s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume volume-22e975e7-616d-4229-a229-52b1cc400713 (22e975e7-616d-4229-a229-52b1cc400713): created successfully
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83805755-a925-4a01-b253-858c2713bd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (d724050c-ac73-4d13-bb0d-89edc585d933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2f293dfb-3c68-4671-b797-46e093f3e700 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created volume successfully.
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created reservations ['06b6945c-4be4-4035-bbed-f8d4e3e146d4', '8d1159a8-5f57-4199-b008-343de723fdf8', 'c60ef0ce-83a5-4d92-ae1d-1cce9ae1da74', '11439a63-69f8-427d-ac91-88d9ff6c47b1'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:41 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:41 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Acquiring lock "cinder-8243319c-8b18-4bee-8ffe-8ce1dd29c367-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Lock "cinder-8243319c-8b18-4bee-8ffe-8ce1dd29c367-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Acquiring lock "cinder-quobyte-8243319c-8b18-4bee-8ffe-8ce1dd29c367" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Lock "cinder-quobyte-8243319c-8b18-4bee-8ffe-8ce1dd29c367" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb75af8-9276-4467-b095-9751ca6a01cd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:41 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 1073741824" returned: 0 in 0.611s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:41 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Deleted volume successfully.
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5ae55dc-e11b-4306-a82e-d3fd906fea3c tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-6743eed5-5bc1-4dc8-955c-37bbea6cc5b6-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:41 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24
Sep 25 18:50:41 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:41 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367
Sep 25 18:50:41 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:42 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24" returned: 0 in 0.286s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.826s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb74899-d16e-4972-a575-67c898f5f580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d085061e85b404089d8b5f3cef4c00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:33Z,use_quota=True,user_id='d8ffce476e284da4af7f30c0628a0cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe93181-afa0-4b08-9c64-1419d60815d5),volume_type_id=5fe93181-afa0-4b08-9c64-1419d60815d5)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Creating volume dfb74899-d16e-4972-a575-67c898f5f580 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:42 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:42 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367" returned: 0 in 0.388s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:42 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 1073741824
Sep 25 18:50:42 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab17892e-575f-4882-858c-610c4e4b8211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d84d1b-6d80-4a61-8252-e929b3336a24', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8bc338-a6a8-4730-be36-d651a5419545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:42 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367
Sep 25 18:50:42 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 (b5d84d1b-6d80-4a61-8252-e929b3336a24): created successfully
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8bc338-a6a8-4730-be36-d651a5419545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (bf94b030-2797-45ed-bd4d-9d2c12cb448e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-aac89d68-8e17-45e4-b4f4-18e9417f3748 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created volume successfully.
Sep 25 18:50:42 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8243319c-8b18-4bee-8ffe-8ce1dd29c367" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Lock "cinder-quobyte-8243319c-8b18-4bee-8ffe-8ce1dd29c367" released by "delete_volume" :: held 0.720s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Created reservations ['5c59b600-557e-4267-8e3f-cb97550b053e', 'd21e42cb-68ff-4118-8467-262cb0dc3759', '437ba671-3815-4e54-8993-14a462ec229b', '3a65f6b3-3729-4f86-9bb6-9ca9d71f77b8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-a63f24e3-ef96-4c7d-80b8-5924403e4db3-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-a63f24e3-ef96-4c7d-80b8-5924403e4db3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:42 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:42 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-quobyte-a63f24e3-ef96-4c7d-80b8-5924403e4db3" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-a63f24e3-ef96-4c7d-80b8-5924403e4db3" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:42 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 1073741824" returned: 0 in 0.554s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b85549-816d-4f4c-b297-aa9ad53ffe4f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:42 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580
Sep 25 18:50:42 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:42 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3
Sep 25 18:50:42 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:42 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Deleted volume successfully.
Sep 25 18:50:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-0fbb3a09-15ee-4677-8eb9-8aee1d3fa6fe tempest-VolumeImageDependencyTests-1424864210 None] Lock "cinder-8243319c-8b18-4bee-8ffe-8ce1dd29c367-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:43 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580" returned: 0 in 0.308s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.385s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314645601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf0d361-cae1-45bf-9495-c36fa321c5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:37Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating volume 3bf0d361-cae1-45bf-9495-c36fa321c5b7 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:43 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:43 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 1073741824
Sep 25 18:50:43 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Attempting download of 6dce226e-db54-4a19-9eee-2aad28a745e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dce226e-db54-4a19-9eee-2aad28a745e1', 'metadata': {}}])) to volume dfb74899-d16e-4972-a575-67c898f5f580. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Sep 25 18:50:43 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3" returned: 0 in 0.439s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:43 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3
Sep 25 18:50:43 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c53c4d-d5f9-4050-b4ce-a971d35fb64d]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:43 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w
Sep 25 18:50:43 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:43 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a63f24e3-ef96-4c7d-80b8-5924403e4db3" returned: 0 in 0.290s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-a63f24e3-ef96-4c7d-80b8-5924403e4db3" released by "delete_volume" :: held 0.790s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created reservations ['2b73ed3e-e8c3-4434-a4f6-cd62898c8078', '82048581-3d69-4aa2-826a-5caaba379a6d', 'c616d749-28f5-4e6a-a6e0-191741cde760', '9b360c97-f9ba-48cb-8718-26b37e087b64'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:43 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:43 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 1073741824" returned: 0 in 0.586s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w" returned: 0 in 0.471s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:43 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:43 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-6a9bae6c-e3f5-4b54-8125-394264df1db9-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:43 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7
Sep 25 18:50:43 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-6a9bae6c-e3f5-4b54-8125-394264df1db9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:43 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w
Sep 25 18:50:43 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-quobyte-6a9bae6c-e3f5-4b54-8125-394264df1db9" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-6a9bae6c-e3f5-4b54-8125-394264df1db9" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64e03bf-8217-4d83-aa01-cd0706558baa]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.404s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Deleted volume successfully.
Sep 25 18:50:44 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7" returned: 0 in 0.369s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:44 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7695d73-14ec-4c66-b0c2-802c9af78361 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-a63f24e3-ef96-4c7d-80b8-5924403e4db3-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:44 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.077s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1521671640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01409fb-a98c-4d10-9d26-3e68ad1c2b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e11fb3e94e4334b30acb0df6deb51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:37Z,use_quota=True,user_id='7f149a2d0a0e40d7b2994c85877cfbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Creating volume b01409fb-a98c-4d10-9d26-3e68ad1c2b89 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:44 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w" returned: 1 in 0.490s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dce226e-db54-4a19-9eee-2aad28a745e1_qou0l_5w' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e405a7-1acc-4ba3-af59-3f7426ffc84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:44 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 1073741824
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd83ea85-167a-49d6-8078-d1ad54e58b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:44 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0067b-3f1f-49ca-b704-328df073e051]: (4, 'raw') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 (3bf0d361-cae1-45bf-9495-c36fa321c5b7): created successfully
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd83ea85-167a-49d6-8078-d1ad54e58b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (b5dfb4ea-a1f8-44b5-baaa-24008290ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e930b803-5558-4637-a882-6560dc07964d tempest-CreateVolumesFromSnapshotTest-999565237 None] Created volume successfully.
Sep 25 18:50:44 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:44 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD
Sep 25 18:50:44 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9" returned: 0 in 0.557s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9
Sep 25 18:50:44 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.495s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:50:44 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 1073741824" returned: 0 in 0.710s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD
Sep 25 18:50:44 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:44 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-6a9bae6c-e3f5-4b54-8125-394264df1db9" returned: 0 in 0.427s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:44 devstack sudo[106971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89
Sep 25 18:50:44 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-6a9bae6c-e3f5-4b54-8125-394264df1db9" released by "delete_volume" :: held 1.062s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:44 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created reservations ['b2bb072c-a045-4367-a3c2-9b24f4864376', 'aeff933c-84af-4de3-87b1-be7f007aabe5', 'ff5066a8-c8b2-4990-b600-b1d6693e3538', '5707ade1-2375-4a1b-887a-ce8474a47a6e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:45 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:45 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:45 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] 6dce226e-db54-4a19-9eee-2aad28a745e1 was raw, converting to qcow2 {{(pid=86534) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:45 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89" returned: 0 in 0.290s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:45 devstack sudo[106979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580
Sep 25 18:50:45 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77fffe4-cfb9-4bf9-9c2e-5c17221603b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91964bb0-c528-4bdc-83a1-7decaff51c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Volume volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 (b01409fb-a98c-4d10-9d26-3e68ad1c2b89): created successfully
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91964bb0-c528-4bdc-83a1-7decaff51c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Flow 'volume_create_manager' (3a73bed3-6ea2-4d40-82c4-f1dc69d6e212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:45 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-7ea0fc35-4c49-4905-b642-b73b0530a0a8 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created volume successfully.
Sep 25 18:50:45 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:45 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Deleted volume successfully.
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-93b8133d-ce3a-4c33-8f52-1bec046b6c3f tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-6a9bae6c-e3f5-4b54-8125-394264df1db9-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:45 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580" returned: 0 in 0.521s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dce226e-db54-4a19-9eee-2aad28a745e1_7bdnz7igdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:50:45 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Converted 0.00 MB image at 0.00 MB/s
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:45 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 1G
Sep 25 18:50:45 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-b01409fb-a98c-4d10-9d26-3e68ad1c2b89-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-b01409fb-a98c-4d10-9d26-3e68ad1c2b89-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-b01409fb-a98c-4d10-9d26-3e68ad1c2b89" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-b01409fb-a98c-4d10-9d26-3e68ad1c2b89" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c927feef-4155-411f-8d9a-87d925067e8a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:46 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-9dd06c0a-5294-471f-919a-f1edcbb49976-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 1G" returned: 0 in 0.416s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Downloaded image 6dce226e-db54-4a19-9eee-2aad28a745e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dce226e-db54-4a19-9eee-2aad28a745e1', 'metadata': {}}])) to volume dfb74899-d16e-4972-a575-67c898f5f580 successfully. {{(pid=86534) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Temporary image 6dce226e-db54-4a19-9eee-2aad28a745e1 for user d8ffce476e284da4af7f30c0628a0cb1 is deleted. {{(pid=86534) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.volume_utils [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Marking volume dfb74899-d16e-4972-a575-67c898f5f580 as bootable. {{(pid=86534) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-9dd06c0a-5294-471f-919a-f1edcbb49976-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Copying metadata from image 6dce226e-db54-4a19-9eee-2aad28a745e1 to dfb74899-d16e-4972-a575-67c898f5f580. {{(pid=86534) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Creating volume glance metadata for volume dfb74899-d16e-4972-a575-67c898f5f580 backed by image 6dce226e-db54-4a19-9eee-2aad28a745e1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'eaf5821250645cf1b16da85c05e0a107', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86534) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-quobyte-9dd06c0a-5294-471f-919a-f1edcbb49976" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:46 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89
Sep 25 18:50:46 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0008df48-11e8-4ba5-aa1e-493eb99b5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb74899-d16e-4972-a575-67c898f5f580', 'volume_size': 1, 'image_id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dce226e-db54-4a19-9eee-2aad28a745e1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eaf5821250645cf1b16da85c05e0a107', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d085061e85b404089d8b5f3cef4c00f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c706c53b7e18bcaabf96627ce11fc232ae8d744ca2a43feaacc5ead84317a666ba48ee12d201ccc39349e7d3cbff75d905abb7fb39070696d10c43d07cfee71', 'id': '6dce226e-db54-4a19-9eee-2aad28a745e1', 'created_at': datetime.datetime(2026, 9, 25, 16, 50, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 16, 50, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dce226e-db54-4a19-9eee-2aad28a745e1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7c1bb7f019d0>}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0594e8c3-f8dd-4b8e-89f0-9ec258c75c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-9dd06c0a-5294-471f-919a-f1edcbb49976" acquired by "delete_volume" :: waited 0.036s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Volume volume-dfb74899-d16e-4972-a575-67c898f5f580 (dfb74899-d16e-4972-a575-67c898f5f580): created successfully
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0594e8c3-f8dd-4b8e-89f0-9ec258c75c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Flow 'volume_create_manager' (c91777cf-40ef-4002-baf3-8b8be565804f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4babad72-652f-498c-ad63-497f628e4e2a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9281ba94-176c-4c8a-a1db-d8bcc01d33ec tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Created volume successfully.
Sep 25 18:50:46 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976
Sep 25 18:50:46 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:46 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89" returned: 0 in 0.436s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:46 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89
Sep 25 18:50:46 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:46 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:46 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976
Sep 25 18:50:46 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:46 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b01409fb-a98c-4d10-9d26-3e68ad1c2b89" returned: 0 in 0.325s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-b01409fb-a98c-4d10-9d26-3e68ad1c2b89" released by "delete_volume" :: held 0.819s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Acquiring lock "cinder-dfb74899-d16e-4972-a575-67c898f5f580-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['822ebd87-38d5-4fe4-a656-41be1479d9de', 'd5e962f0-8bce-45d5-bc64-d4b03acc24f2', '83a43858-8b57-4aa9-b15a-a7fda401b26d', '8eb1e1d9-82c6-4946-adf0-a7032ecee66d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "cinder-dfb74899-d16e-4972-a575-67c898f5f580-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:46 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Flow 'volume_create_manager' (bc048216-ebc0-4bf7-b763-1c5d1253d84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48bbbc5-21a1-4682-974f-9bdd1fc0f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9dd06c0a-5294-471f-919a-f1edcbb49976" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48bbbc5-21a1-4682-974f-9bdd1fc0f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d19af2-07bc-4dfa-94f9-9d689817789b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8af770b6b874d81bd76b8a4fd39fbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:47Z,use_quota=True,user_id='07a864941eb649d7a152a3f688e74cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823d0e0f-e129-460a-91b9-3811493f2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823d0e0f-e129-460a-91b9-3811493f2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1776c7-0b92-466a-a171-c2d00ff08d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1776c7-0b92-466a-a171-c2d00ff08d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d19af2-07bc-4dfa-94f9-9d689817789b', 'volume_name': 'volume-75d19af2-07bc-4dfa-94f9-9d689817789b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be3110d-dc7b-49d4-a70f-539550a8de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be3110d-dc7b-49d4-a70f-539550a8de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0feef1e-e2e9-40f7-ae04-abf469ba4637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Volume 75d19af2-07bc-4dfa-94f9-9d689817789b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d19af2-07bc-4dfa-94f9-9d689817789b', 'volume_size': 1}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d19af2-07bc-4dfa-94f9-9d689817789b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8af770b6b874d81bd76b8a4fd39fbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:47Z,use_quota=True,user_id='07a864941eb649d7a152a3f688e74cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Creating volume 75d19af2-07bc-4dfa-94f9-9d689817789b {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:47 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b 1073741824
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:47 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-9dd06c0a-5294-471f-919a-f1edcbb49976" released by "delete_volume" :: held 0.864s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-3bf0d361-cae1-45bf-9495-c36fa321c5b7-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Acquiring lock "cinder-quobyte-dfb74899-d16e-4972-a575-67c898f5f580" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-3bf0d361-cae1-45bf-9495-c36fa321c5b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "cinder-quobyte-dfb74899-d16e-4972-a575-67c898f5f580" acquired by "delete_volume" :: waited 0.049s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:47 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5e0b87-8303-49b6-a76a-084a99d9b65f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:47 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-3bf0d361-cae1-45bf-9495-c36fa321c5b7" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-3bf0d361-cae1-45bf-9495-c36fa321c5b7" acquired by "delete_volume" :: waited 0.049s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created reservations ['4d3c4b1b-330f-40e2-97c7-5e0c786e49c2', '02799e9d-845f-4e7e-a645-1e7a9eb1ac38', 'c64bedbb-ec79-4454-ad3d-644615449d3f', '32437529-44e3-4ce6-8530-635018432bed'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7350ac-fa70-4c28-8304-99bd97fe8659]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:47 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580
Sep 25 18:50:47 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7
Sep 25 18:50:47 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.357s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleted volume successfully.
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f7e208e5-2bbe-4a2a-b084-a758c3afe92f tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-b01409fb-a98c-4d10-9d26-3e68ad1c2b89-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:47 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b 1073741824" returned: 0 in 0.712s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b
Sep 25 18:50:47 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.405s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Deleted volume successfully.
Sep 25 18:50:47 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:47 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7" returned: 0 in 0.548s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580" returned: 0 in 0.688s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:47 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7
Sep 25 18:50:47 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5df396d2-4bd7-4ca0-85df-e2749b0d1477 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-9dd06c0a-5294-471f-919a-f1edcbb49976-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:47 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580
Sep 25 18:50:47 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:48 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0feef1e-e2e9-40f7-ae04-abf469ba4637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d19af2-07bc-4dfa-94f9-9d689817789b', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3389f57-5afe-491c-aa77-26c12e7fef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:48 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Volume volume-75d19af2-07bc-4dfa-94f9-9d689817789b (75d19af2-07bc-4dfa-94f9-9d689817789b): created successfully
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3389f57-5afe-491c-aa77-26c12e7fef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Flow 'volume_create_manager' (bc048216-ebc0-4bf7-b763-1c5d1253d84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-199fe223-7ac4-40c3-b649-5eb2261a5f37 tempest-CinderUnicodeTest-125317326 None] Created volume successfully.
Sep 25 18:50:48 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:48 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3bf0d361-cae1-45bf-9495-c36fa321c5b7" returned: 0 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dfb74899-d16e-4972-a575-67c898f5f580" returned: 0 in 0.308s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-3bf0d361-cae1-45bf-9495-c36fa321c5b7" released by "delete_volume" :: held 0.931s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "cinder-quobyte-dfb74899-d16e-4972-a575-67c898f5f580" released by "delete_volume" :: held 1.116s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['e7d29863-6105-4275-9ea0-5a557fbb9fc2', '6d58cca6-b5ac-4cac-a5b0-d792b57cb3e5', '1fd0938b-2a40-46a4-9c92-e92902e0c209', '59c19257-6ab5-4a64-bf6f-32dd9213d62c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Created reservations ['636ff6fd-4b45-4362-82ff-e244823dfb0e', '33fcfc64-4cf1-4f74-a8d0-b7d6f02e2fad', '564c719d-1e8f-4ad3-8b0c-3dc3d110ccb9', '63b62d8e-3a6e-4593-b877-c8c2eac306d7'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-2c10a50d-d559-4f67-ad53-5a60828132c8-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-2c10a50d-d559-4f67-ad53-5a60828132c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-quobyte-2c10a50d-d559-4f67-ad53-5a60828132c8" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:48 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:48 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-2c10a50d-d559-4f67-ad53-5a60828132c8" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[587f945b-b5bf-4e17-876a-3fa7403b5e9c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:48 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:48 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:48 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8
Sep 25 18:50:48 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:48 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleted volume successfully.
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-62e1bb35-e798-460d-86bb-74a36f7c2f11 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-3bf0d361-cae1-45bf-9495-c36fa321c5b7-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:48 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Deleted volume successfully.
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6b360942-f1cc-4dfa-9dbf-5813675a5c26 tempest-VolumeAndVolumeTypeFromImageTest-771587344 None] Lock "cinder-dfb74899-d16e-4972-a575-67c898f5f580-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:48 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:48 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8
Sep 25 18:50:48 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:49 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2c10a50d-d559-4f67-ad53-5a60828132c8" returned: 0 in 0.262s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-2c10a50d-d559-4f67-ad53-5a60828132c8" released by "delete_volume" :: held 0.714s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created reservations ['65801e6c-59a3-44fd-bf66-95cd2bec60bd', '970d4561-7a75-4132-9428-758f02039864', '08592079-f607-4405-95a0-6bb85fd3a022', '3f3df9d6-d233-4db2-bb3a-7f510dc9b24a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:49 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:49 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-b5d84d1b-6d80-4a61-8252-e929b3336a24-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-b5d84d1b-6d80-4a61-8252-e929b3336a24-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-b5d84d1b-6d80-4a61-8252-e929b3336a24" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-b5d84d1b-6d80-4a61-8252-e929b3336a24" acquired by "delete_volume" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e9272-66b9-47e7-bbbb-82759b1fdcea]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-acae08f7-ce5b-4389-bd19-65c4b384e407-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Flow 'volume_create_manager' (effa6cf6-01b5-4002-99b3-622868178a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bc7a84-b1e2-4f06-a9ba-1c4bce98fc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-acae08f7-ce5b-4389-bd19-65c4b384e407-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68bc7a84-b1e2-4f06-a9ba-1c4bce98fc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-124236246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5419c5a3-561e-4e28-bc44-053dc2f2a54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8af770b6b874d81bd76b8a4fd39fbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:50Z,use_quota=True,user_id='07a864941eb649d7a152a3f688e74cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86490f2c-f8cb-4e41-a8bf-f984ea91eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86490f2c-f8cb-4e41-a8bf-f984ea91eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ea6943-8a56-4ffa-abc0-51eb6988058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ea6943-8a56-4ffa-abc0-51eb6988058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5419c5a3-561e-4e28-bc44-053dc2f2a54f', 'volume_name': 'volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ab8604-b7a3-4d08-898b-73bdc194e9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:49 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24
Sep 25 18:50:49 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:49 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ab8604-b7a3-4d08-898b-73bdc194e9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e5a283-5980-4ac3-993d-ee2026e1a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Volume 5419c5a3-561e-4e28-bc44-053dc2f2a54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f', 'volume_size': 1}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-124236246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5419c5a3-561e-4e28-bc44-053dc2f2a54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8af770b6b874d81bd76b8a4fd39fbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:50Z,use_quota=True,user_id='07a864941eb649d7a152a3f688e74cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Creating volume 5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:49 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.423s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Deleted volume successfully.
Sep 25 18:50:49 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f 1073741824
Sep 25 18:50:49 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "cinder-quobyte-acae08f7-ce5b-4389-bd19-65c4b384e407" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4ab4c0f0-0c06-428b-a67f-5268b74c1d8b tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-2c10a50d-d559-4f67-ad53-5a60828132c8-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-acae08f7-ce5b-4389-bd19-65c4b384e407" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc32402-528d-41a1-8d9b-cbdae1e5c1e6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:50 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407
Sep 25 18:50:50 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:50 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24" returned: 0 in 0.461s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:50 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24
Sep 25 18:50:50 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:50 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f 1073741824" returned: 0 in 0.491s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:50 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f
Sep 25 18:50:50 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:50 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407" returned: 0 in 0.457s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:50 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b5d84d1b-6d80-4a61-8252-e929b3336a24" returned: 0 in 0.310s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407
Sep 25 18:50:50 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-b5d84d1b-6d80-4a61-8252-e929b3336a24" released by "delete_volume" :: held 0.839s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['c5e637af-d562-4d98-bf92-a24e3ea0408f', '856880be-5bb9-4e8a-8aec-a0e7fc4bb65c', '32f31f98-1a42-49b4-b016-bd0f59bf0bfa', 'ef17d7c7-9042-4333-8ef8-7abe05f9ec8d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:50 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:50 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:50 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e5a283-5980-4ac3-993d-ee2026e1a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aeb4e31-56ee-4440-ae12-ff3b176a5938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:50 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Volume volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f (5419c5a3-561e-4e28-bc44-053dc2f2a54f): created successfully
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aeb4e31-56ee-4440-ae12-ff3b176a5938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Flow 'volume_create_manager' (effa6cf6-01b5-4002-99b3-622868178a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fa895d4b-c58d-46db-98a8-0320ecda3b2d tempest-CinderUnicodeTest-125317326 None] Created volume successfully.
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-22e975e7-616d-4229-a229-52b1cc400713-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-22e975e7-616d-4229-a229-52b1cc400713-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:50 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-acae08f7-ce5b-4389-bd19-65c4b384e407" returned: 0 in 0.447s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-quobyte-acae08f7-ce5b-4389-bd19-65c4b384e407" released by "delete_volume" :: held 0.996s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-22e975e7-616d-4229-a229-52b1cc400713" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-22e975e7-616d-4229-a229-52b1cc400713" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:50 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.389s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:50 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleted volume successfully.
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5507f427-950e-4403-b085-242bd2a692e1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c9499cb3-ca0f-42d3-87ad-79bd84fb61ed tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-b5d84d1b-6d80-4a61-8252-e929b3336a24-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:50 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Created reservations ['22c17509-56cb-4a99-b39f-fd53960e8199', '355213f1-b5a5-4560-854a-ae4a161bbcaf', '2b75406c-0fd6-416d-a64d-549e180b84fe', '5babf244-5022-4462-979e-979c5f55151e'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:51 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713
Sep 25 18:50:51 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:51 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:51 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:51 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:51 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Deleted volume successfully.
Sep 25 18:50:51 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713" returned: 0 in 0.420s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:51 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713
Sep 25 18:50:51 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-436327c4-1b29-49af-9a38-35fd3607d104 tempest-CreateVolumesFromSourceVolumeTest-1006610180 None] Lock "cinder-acae08f7-ce5b-4389-bd19-65c4b384e407-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:51 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-22e975e7-616d-4229-a229-52b1cc400713" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-22e975e7-616d-4229-a229-52b1cc400713" released by "delete_volume" :: held 0.754s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['1d4dcb97-a1af-4910-992f-614bf5adef1e', 'b6f13fad-259a-4f35-8663-2f38921887e2', 'da2fc546-d6d4-42c4-bc3a-d60fd8d818de', '775e0be4-3fa1-48f8-bfb8-161eb8518b0c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:51 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:51 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-a5414f24-014e-439f-a83a-8734c439ce01-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-a5414f24-014e-439f-a83a-8734c439ce01-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:52 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.370s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleted volume successfully.
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-a5414f24-014e-439f-a83a-8734c439ce01" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Creating offline snapshot 3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 of volume 5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d36a71ec-694a-4674-9875-a4cbb986da09 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-22e975e7-616d-4229-a229-52b1cc400713-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-a5414f24-014e-439f-a83a-8734c439ce01" acquired by "delete_volume" :: waited 0.043s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcf2bbf-1cb0-4473-9300-0bc5ad0ec231]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[972bd02b-1e1e-4845-b8c4-880fbe16c8b1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:52 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f
Sep 25 18:50:52 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:52 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01
Sep 25 18:50:52 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:52 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01" returned: 0 in 0.438s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:52 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f" returned: 0 in 0.493s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:52 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01
Sep 25 18:50:52 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:52 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 1G
Sep 25 18:50:52 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:53 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-a5414f24-014e-439f-a83a-8734c439ce01" returned: 0 in 0.290s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-a5414f24-014e-439f-a83a-8734c439ce01" released by "delete_volume" :: held 0.793s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['8b436c4d-fc2e-407d-b29e-70217561e944', '530b7b23-b57a-4d68-b02e-c3636580df5a', '54c39736-6c8d-4c66-84f4-a7e1cb2005a1', '80747767-2130-42bb-afaf-b3a9e6b72cc2'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:53 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:53 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:53 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 1G" returned: 0 in 0.586s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-355846d9-7500-42cc-be7d-7b9ed63ef7b5" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:53 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0
Sep 25 18:50:53 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-355846d9-7500-42cc-be7d-7b9ed63ef7b5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleting offline snapshot 09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 of volume 355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] snapshot_file for this snap is: volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[92220a98-1efa-4fc7-9b25-a6d36b86a38d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:53 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.372s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:53 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2
Sep 25 18:50:53 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleted volume successfully.
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-322d5c40-d8d3-4102-bf9d-301605d57470 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-a5414f24-014e-439f-a83a-8734c439ce01-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:53 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" returned: 0 in 0.493s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:53 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 is being set with open permissions: ugo+rw
Sep 25 18:50:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:53 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0
Sep 25 18:50:53 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:54 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" returned: 0 in 0.478s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120bfed-4949-41c3-bc63-a5f2635a4d65]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:54 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5
Sep 25 18:50:54 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:54 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" returned: 0 in 0.336s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:54 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info
Sep 25 18:50:54 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:54 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5" returned: 0 in 0.517s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:54 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info" returned: 0 in 0.350s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:54 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2
Sep 25 18:50:54 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info is being set with open permissions: ugo+rw
Sep 25 18:50:54 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:54 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info
Sep 25 18:50:54 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:54 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.info" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:55 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6ecbb8d0-3a08-4862-a95f-60a65ff0ae82 tempest-CinderUnicodeTest-125317326 None] Create snapshot completed successfully
Sep 25 18:50:55 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" returned: 0 in 0.478s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:55 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2
Sep 25 18:50:55 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (72e02afb-a779-427e-a554-2df6acb401ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bb7afa-59c9-4df4-9c58-0fd382f2f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bb7afa-59c9-4df4-9c58-0fd382f2f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-861571688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b540d209-3f7d-4010-a160-639d64b2717a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:55Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea64bd6-7f35-4895-94c8-7c843da06e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea64bd6-7f35-4895-94c8-7c843da06e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc22d6d6-859c-402a-b2b9-9b8f3b83c8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc22d6d6-859c-402a-b2b9-9b8f3b83c8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b540d209-3f7d-4010-a160-639d64b2717a', 'volume_name': 'volume-b540d209-3f7d-4010-a160-639d64b2717a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e1b722-0917-42e3-a220-541b4e3e665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e1b722-0917-42e3-a220-541b4e3e665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982e5c7d-0c03-4c5e-a132-323c11b8095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Volume b540d209-3f7d-4010-a160-639d64b2717a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b540d209-3f7d-4010-a160-639d64b2717a', 'volume_size': 1}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-861571688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b540d209-3f7d-4010-a160-639d64b2717a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:55Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Creating volume b540d209-3f7d-4010-a160-639d64b2717a {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:55 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:55 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a 1073741824
Sep 25 18:50:55 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Lock "cinder-3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-quobyte-5419c5a3-561e-4e28-bc44-053dc2f2a54f" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-5419c5a3-561e-4e28-bc44-053dc2f2a54f" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-quobyte-3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:55 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Deleting offline snapshot 3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 of volume 5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] snapshot_file for this snap is: volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5.09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" returned: 0 in 0.577s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac3aa7-a29f-452c-aef1-fd6f8e1662e4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2" released by "_delete_snapshot" :: held 2.236s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-355846d9-7500-42cc-be7d-7b9ed63ef7b5" released by "delete_snapshot" :: held 2.272s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:55 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0
Sep 25 18:50:55 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (e469168a-6f08-431c-93e8-f26275d3a6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38381227-1605-43a1-8686-b9b8edaa4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38381227-1605-43a1-8686-b9b8edaa4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290851560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f6df08-ceaf-492d-bc11-a5c64b8c292f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:56Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004dab0-2849-4451-9d7b-ce3eb5acdfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004dab0-2849-4451-9d7b-ce3eb5acdfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f15748-dc57-4450-8063-b505605e7730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f15748-dc57-4450-8063-b505605e7730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f6df08-ceaf-492d-bc11-a5c64b8c292f', 'volume_name': 'volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f191db-93f5-4a9c-9aa1-2853ad8ee606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f191db-93f5-4a9c-9aa1-2853ad8ee606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8bcac3-5af7-4acf-856b-3470c68efc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:55 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Volume c0f6df08-ceaf-492d-bc11-a5c64b8c292f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f', 'volume_size': 1}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:55 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a 1073741824" returned: 0 in 0.684s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:55 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['6f6ead19-4985-488f-9c7e-106b426f5192', 'faf5f6f8-65c4-4a4c-aaf4-f7b36ae42b76', '4836e40a-9ea6-4f01-8339-d5d0ae63228e', '7806c84b-f507-47ff-b1b2-b27a5d16bf79'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:56 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a
Sep 25 18:50:56 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Delete snapshot completed successfully.
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d133f49f-7588-4b09-944b-0e8b4ac9929c tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-09e2d56c-b46a-41b4-a375-c5e7a0fa1bc2-delete_snapshot" released by "delete_snapshot" :: held 2.708s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:56 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" returned: 0 in 0.547s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f143ec6-b18e-4abe-8415-a96546369ddf]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:56 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a" returned: 0 in 0.321s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290851560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f6df08-ceaf-492d-bc11-a5c64b8c292f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:56Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Creating volume c0f6df08-ceaf-492d-bc11-a5c64b8c292f {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:56 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:56 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f
Sep 25 18:50:56 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982e5c7d-0c03-4c5e-a132-323c11b8095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b540d209-3f7d-4010-a160-639d64b2717a', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8f1f2d-d664-4e70-96ed-3f33ba49a8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:56 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f 1073741824
Sep 25 18:50:56 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:56 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Volume volume-b540d209-3f7d-4010-a160-639d64b2717a (b540d209-3f7d-4010-a160-639d64b2717a): created successfully
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8f1f2d-d664-4e70-96ed-3f33ba49a8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (72e02afb-a779-427e-a554-2df6acb401ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (84f51b69-6ec0-4486-a855-b57a8527f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5630a4-8819-48c4-90f3-c195c1fd6aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5630a4-8819-48c4-90f3-c195c1fd6aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828478419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b2d42c-1f0b-4d1a-b30c-69600003dcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:56Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4e4e26-33f3-484d-b373-21e8dc412dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4e4e26-33f3-484d-b373-21e8dc412dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b8c5bd-9bb1-4631-9662-dbc5ddeda509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b8c5bd-9bb1-4631-9662-dbc5ddeda509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b2d42c-1f0b-4d1a-b30c-69600003dcc7', 'volume_name': 'volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa20aaec-c20a-4fd1-b4ee-8cf609feabe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa20aaec-c20a-4fd1-b4ee-8cf609feabe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d34c8-cf33-4971-9bbb-fe7cb7a5844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:56 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Volume 43b2d42c-1f0b-4d1a-b30c-69600003dcc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7', 'volume_size': 1}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:56 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6900168f-6e8a-44e2-9e23-e32d7a62fb03 tempest-CreateVolumesFromImageTest-774497831 None] Created volume successfully.
Sep 25 18:50:56 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f" returned: 0 in 0.577s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:56 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:56 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0
Sep 25 18:50:56 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:57 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (c6e9c91c-fdcb-4826-85c2-8fdbc5579f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3493f236-34d9-4e39-8fca-f072408970ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-355846d9-7500-42cc-be7d-7b9ed63ef7b5-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f 1073741824" returned: 0 in 0.672s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3493f236-34d9-4e39-8fca-f072408970ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277921233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8c4b0e-6724-40f2-b273-4447ffc78603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:57Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358f6a18-f12f-4206-894e-0f79b7a69bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358f6a18-f12f-4206-894e-0f79b7a69bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feb3e5a-bb6f-413f-a4b9-7f5420125bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feb3e5a-bb6f-413f-a4b9-7f5420125bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8c4b0e-6724-40f2-b273-4447ffc78603', 'volume_name': 'volume-1a8c4b0e-6724-40f2-b273-4447ffc78603', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c734e5c-12b3-4c11-bf5a-9144c6a911a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c734e5c-12b3-4c11-bf5a-9144c6a911a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af743cf4-443e-4f74-929b-cd91f974a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Volume 1a8c4b0e-6724-40f2-b273-4447ffc78603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8c4b0e-6724-40f2-b273-4447ffc78603', 'volume_size': 1}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d3b90860-6049-42aa-94db-18a4f4bba497 tempest-ProjectAdminTests-51745280 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2824325561523, 'free_capacity_gb': 1775.2824325561523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86534) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-355846d9-7500-42cc-be7d-7b9ed63ef7b5-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "cinder-quobyte-355846d9-7500-42cc-be7d-7b9ed63ef7b5" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:57 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f
Sep 25 18:50:57 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-355846d9-7500-42cc-be7d-7b9ed63ef7b5" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9791427-fcc1-4e14-b93c-742bc20577f2]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:57 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" returned: 0 in 0.550s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:57 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0
Sep 25 18:50:57 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:57 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5
Sep 25 18:50:57 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:57 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f" returned: 0 in 0.473s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828478419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b2d42c-1f0b-4d1a-b30c-69600003dcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:56Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Creating volume 43b2d42c-1f0b-4d1a-b30c-69600003dcc7 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:57 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:50:57 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:57 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 1073741824
Sep 25 18:50:57 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (4e5e11ad-0a7f-4e4e-b5d8-182b80fcb64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b00f7f7-e750-4d0e-ae9f-ec71a584aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f.3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" returned: 0 in 0.387s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b00f7f7-e750-4d0e-ae9f-ec71a584aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1465356708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9babbacb-5149-4dca-9684-535faee43e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:58Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c2a80b-aa54-4af1-8bda-a4038cb98f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c2a80b-aa54-4af1-8bda-a4038cb98f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d2ff9e-75b2-4e1d-8668-ea32cd07f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d2ff9e-75b2-4e1d-8668-ea32cd07f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9babbacb-5149-4dca-9684-535faee43e45', 'volume_name': 'volume-9babbacb-5149-4dca-9684-535faee43e45', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7c8996-70ec-41d4-b7d0-a9143bf97145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7c8996-70ec-41d4-b7d0-a9143bf97145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e68dbd-9cfb-4ff1-89ad-71d3a1caae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Volume 9babbacb-5149-4dca-9684-535faee43e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9babbacb-5149-4dca-9684-535faee43e45', 'volume_size': 1}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8bcac3-5af7-4acf-856b-3470c68efc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45819487-f084-40cf-b9b3-4432ff9bafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:57 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5" returned: 0 in 0.539s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:57 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Volume volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f (c0f6df08-ceaf-492d-bc11-a5c64b8c292f): created successfully
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45819487-f084-40cf-b9b3-4432ff9bafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (e469168a-6f08-431c-93e8-f26275d3a6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:57 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5
Sep 25 18:50:57 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0" released by "_delete_snapshot" :: held 2.334s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:57 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-5419c5a3-561e-4e28-bc44-053dc2f2a54f" released by "delete_snapshot" :: held 2.395s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:57 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2183c6cd-cbe2-4e37-9888-34c7bf9ab7e0 tempest-CreateVolumesFromImageTest-774497831 None] Created volume successfully.
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Created reservations ['83a923a3-a45b-4f58-b356-be2448949e5f', '0c8bfb09-99f1-4cd3-858d-accbb4ef3647', '5b004cd7-31e7-4159-9dab-f2ba07a8e31c', '008f63dc-87ab-48ed-a6e5-ca3cc16f3380'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Delete snapshot completed successfully.
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e3d8c7ec-076b-4823-b83a-3375ae75db9a tempest-CinderUnicodeTest-125317326 None] Lock "cinder-3feb0cf5-fdcf-4fa9-9f89-b02edfeb59d0-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:58 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-355846d9-7500-42cc-be7d-7b9ed63ef7b5" returned: 0 in 0.300s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-quobyte-355846d9-7500-42cc-be7d-7b9ed63ef7b5" released by "delete_volume" :: held 0.947s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:58 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 1073741824" returned: 0 in 0.539s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Created reservations ['0237fd02-da91-406a-bc39-6bab86d4a85a', '2e504dfc-2ee8-4fba-b0e6-552e6c26add3', 'c0ef6b80-30bb-466f-b5d0-b5e37d67bdd0', 'cdecab56-3066-4f5f-a384-cd4d5fc93980'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:58 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7
Sep 25 18:50:58 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:58 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:50:58 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:58 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7" returned: 0 in 0.307s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1277921233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8c4b0e-6724-40f2-b273-4447ffc78603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:57Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Creating volume 1a8c4b0e-6724-40f2-b273-4447ffc78603 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:58 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d34c8-cf33-4971-9bbb-fe7cb7a5844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899e19e8-b3ad-4b36-9b3b-13f3aedce09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:58 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 1073741824
Sep 25 18:50:58 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:58 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Volume volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 (43b2d42c-1f0b-4d1a-b30c-69600003dcc7): created successfully
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899e19e8-b3ad-4b36-9b3b-13f3aedce09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (84f51b69-6ec0-4486-a855-b57a8527f507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:58 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.299s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:50:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-668b0e56-7544-4413-951a-b7fa225ef01f tempest-CreateVolumesFromImageTest-774497831 None] Created volume successfully.
Sep 25 18:50:58 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Deleted volume successfully.
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-983b1500-a9ac-47c1-aad7-d489ac046956 tempest-CreateVolumesFromSnapshotTest-999565237 None] Lock "cinder-355846d9-7500-42cc-be7d-7b9ed63ef7b5-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-5419c5a3-561e-4e28-bc44-053dc2f2a54f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-5419c5a3-561e-4e28-bc44-053dc2f2a54f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-quobyte-5419c5a3-561e-4e28-bc44-053dc2f2a54f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-5419c5a3-561e-4e28-bc44-053dc2f2a54f" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[05255dc8-7771-47e0-a738-dca84df593c7]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:50:58 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:59 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f
Sep 25 18:50:59 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:59 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 1073741824" returned: 0 in 0.568s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:59 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603
Sep 25 18:50:59 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:59 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:59 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f
Sep 25 18:50:59 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:59 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603" returned: 0 in 0.296s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1465356708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9babbacb-5149-4dca-9684-535faee43e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b919ba1e54e4816a49bda01de7b6c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:50:58Z,use_quota=True,user_id='8563156de8624786baddc7119efe7f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Creating volume 9babbacb-5149-4dca-9684-535faee43e45 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:50:59 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:50:59 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45 1073741824
Sep 25 18:50:59 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af743cf4-443e-4f74-929b-cd91f974a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8c4b0e-6724-40f2-b273-4447ffc78603', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5ddc37-1fcf-4035-89d4-9c9694c1795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:50:59 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Volume volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 (1a8c4b0e-6724-40f2-b273-4447ffc78603): created successfully
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5ddc37-1fcf-4035-89d4-9c9694c1795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (c6e9c91c-fdcb-4826-85c2-8fdbc5579f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:50:59 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8e1a066a-c7de-4f19-b1e2-5dc822d0a381 tempest-CreateVolumesFromImageTest-774497831 None] Created volume successfully.
Sep 25 18:50:59 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-5419c5a3-561e-4e28-bc44-053dc2f2a54f" returned: 0 in 0.362s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-5419c5a3-561e-4e28-bc44-053dc2f2a54f" released by "delete_volume" :: held 0.864s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Created reservations ['1d77cfb6-624e-43af-b35b-5c66c3f5b527', 'ba9b258d-7691-478b-8ac2-6a9eb0360e99', 'bef964f1-83ca-4431-9681-9bec73186917', 'da122f3c-df44-4276-810b-160fb35e4452'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:50:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:00 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:00 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-75d19af2-07bc-4dfa-94f9-9d689817789b-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-75d19af2-07bc-4dfa-94f9-9d689817789b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "cinder-quobyte-75d19af2-07bc-4dfa-94f9-9d689817789b" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:00 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45 1073741824" returned: 0 in 0.708s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-75d19af2-07bc-4dfa-94f9-9d689817789b" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a9d63-83f4-4323-808a-510f78066dfd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:00 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45
Sep 25 18:51:00 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:00 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.354s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Deleted volume successfully.
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-eab97e6b-76d9-4d60-90b9-284f060998e5 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-5419c5a3-561e-4e28-bc44-053dc2f2a54f-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:00 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b
Sep 25 18:51:00 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:00 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45" returned: 0 in 0.381s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e68dbd-9cfb-4ff1-89ad-71d3a1caae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9babbacb-5149-4dca-9684-535faee43e45', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d64ca3e-38be-42b6-9106-dc2a0e67a577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:00 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Volume volume-9babbacb-5149-4dca-9684-535faee43e45 (9babbacb-5149-4dca-9684-535faee43e45): created successfully
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d64ca3e-38be-42b6-9106-dc2a0e67a577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Flow 'volume_create_manager' (4e5e11ad-0a7f-4e4e-b5d8-182b80fcb64d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-51e3fb76-2c64-4e4e-8ec5-5cf4caec713e tempest-CreateVolumesFromImageTest-774497831 None] Created volume successfully.
Sep 25 18:51:00 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b" returned: 0 in 0.528s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:00 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b
Sep 25 18:51:00 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:01 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-75d19af2-07bc-4dfa-94f9-9d689817789b" returned: 0 in 0.276s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-quobyte-75d19af2-07bc-4dfa-94f9-9d689817789b" released by "delete_volume" :: held 0.882s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Created reservations ['9b9b67a8-8643-4f9f-80ff-614fa1d7e66e', '9094b591-4168-41ab-b54a-d3ae52c2136a', '6cd8dc86-ee5a-4c97-93a9-3989605db497', 'bdf3449a-6913-4983-8c0b-112bef2eac5c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-9babbacb-5149-4dca-9684-535faee43e45-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-9babbacb-5149-4dca-9684-535faee43e45-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-quobyte-9babbacb-5149-4dca-9684-535faee43e45" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-9babbacb-5149-4dca-9684-535faee43e45" acquired by "delete_volume" :: waited 0.042s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:01 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:01 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d4076-887f-43e7-805a-bda7f1e58739]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:01 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45
Sep 25 18:51:01 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:01 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.316s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:01 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Deleted volume successfully.
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-90357662-4d5b-45f2-93b8-1d4b13de4c74 tempest-CinderUnicodeTest-125317326 None] Lock "cinder-75d19af2-07bc-4dfa-94f9-9d689817789b-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:01 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45" returned: 0 in 0.445s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:01 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45
Sep 25 18:51:01 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:02 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9babbacb-5149-4dca-9684-535faee43e45" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-9babbacb-5149-4dca-9684-535faee43e45" released by "delete_volume" :: held 0.765s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Created reservations ['a33d2793-f324-42fb-a088-f0bd5c04fab3', 'f2e9a6ac-bf88-45c0-b0b3-5c2562477a15', '4638503f-7a35-4794-b57b-ed305357b398', '347e8ed3-3d56-4bdd-a7e9-ecbb81761825'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:02 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:02 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-1a8c4b0e-6724-40f2-b273-4447ffc78603-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-1a8c4b0e-6724-40f2-b273-4447ffc78603-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (138ee3e4-60cc-47e9-9be8-d8d0b3b9dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c177972-789c-4f1e-ac60-a685cf3b91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c177972-789c-4f1e-ac60-a685cf3b91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037564020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05300183-29e6-4cde-8a42-c766774cae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:02Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7640b314-687b-481a-8fc8-83cc3e2cee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7640b314-687b-481a-8fc8-83cc3e2cee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ea5020-84a0-443f-93ef-13097c3a0422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ea5020-84a0-443f-93ef-13097c3a0422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05300183-29e6-4cde-8a42-c766774cae70', 'volume_name': 'volume-05300183-29e6-4cde-8a42-c766774cae70', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be6db4-28a7-4917-ae7f-1cda43bac6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be6db4-28a7-4917-ae7f-1cda43bac6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90ed659-63d6-4db5-b7c0-b8b87e5be936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:02 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Volume 05300183-29e6-4cde-8a42-c766774cae70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05300183-29e6-4cde-8a42-c766774cae70', 'volume_size': 1}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037564020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05300183-29e6-4cde-8a42-c766774cae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:02Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Creating volume 05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:02 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:02 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-quobyte-1a8c4b0e-6724-40f2-b273-4447ffc78603" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.421s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:02 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 1073741824
Sep 25 18:51:02 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Deleted volume successfully.
Sep 25 18:51:02 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-1a8c4b0e-6724-40f2-b273-4447ffc78603" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-730fca77-6c38-4f2f-8dd4-d6cd39561dd4 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-9babbacb-5149-4dca-9684-535faee43e45-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4061f37-dc7c-4cb5-9ca0-c2fdff2a8579]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:02 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603
Sep 25 18:51:02 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:03 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 1073741824" returned: 0 in 0.577s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:03 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603" returned: 0 in 0.497s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:03 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603
Sep 25 18:51:03 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:03 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70
Sep 25 18:51:03 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:03 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Flow 'volume_create_manager' (f67db7bc-bd49-40e0-a3c0-054a978d7627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e9247a-e86c-4166-a084-374d6716dcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1a8c4b0e-6724-40f2-b273-4447ffc78603" returned: 0 in 0.394s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e9247a-e86c-4166-a084-374d6716dcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-959263541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e68906-042d-4400-b2c4-219abdcb8087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c81e214b7248c481a39921752c8145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:04Z,use_quota=True,user_id='004761138d0e473ca06281f32c0b05b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225e968c-25c4-4f42-974f-fb8f81288a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225e968c-25c4-4f42-974f-fb8f81288a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590a3726-8d33-45f6-b2f1-85a9e0751cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:03 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590a3726-8d33-45f6-b2f1-85a9e0751cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e68906-042d-4400-b2c4-219abdcb8087', 'volume_name': 'volume-82e68906-042d-4400-b2c4-219abdcb8087', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6522c3d2-29b2-43d9-a9fe-4a99a380300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6522c3d2-29b2-43d9-a9fe-4a99a380300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98afeedc-6fa5-4397-9430-e1911f6944a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Volume 82e68906-042d-4400-b2c4-219abdcb8087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e68906-042d-4400-b2c4-219abdcb8087', 'volume_size': 1}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-1a8c4b0e-6724-40f2-b273-4447ffc78603" released by "delete_volume" :: held 1.016s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70" returned: 0 in 0.428s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-959263541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e68906-042d-4400-b2c4-219abdcb8087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c81e214b7248c481a39921752c8145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:04Z,use_quota=True,user_id='004761138d0e473ca06281f32c0b05b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Creating volume 82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:03 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:03 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 1073741824
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90ed659-63d6-4db5-b7c0-b8b87e5be936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05300183-29e6-4cde-8a42-c766774cae70', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:03 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294ff94c-6609-4c90-9fdb-e1ec34b0c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Volume volume-05300183-29e6-4cde-8a42-c766774cae70 (05300183-29e6-4cde-8a42-c766774cae70): created successfully
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294ff94c-6609-4c90-9fdb-e1ec34b0c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (138ee3e4-60cc-47e9-9be8-d8d0b3b9dd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f30a7ea6-05e0-4bd0-8530-2c9fa1926622 tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Created reservations ['257a535c-35f9-44bd-bf5a-8e63460bf859', '8b40f56d-31c3-4bc8-8f8d-6bca325b1bd9', '2dc4dd0c-ebfa-412f-bf14-d3a6b6340ea6', '3af24b8e-ca77-46f9-bc37-657ed2d561b0'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:04 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:04 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:04 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.296s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Deleted volume successfully.
Sep 25 18:51:04 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 1073741824" returned: 0 in 0.513s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ff00b45e-f6df-4b00-82e7-108d469084f9 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-1a8c4b0e-6724-40f2-b273-4447ffc78603-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:04 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087
Sep 25 18:51:04 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:04 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087" returned: 0 in 0.273s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98afeedc-6fa5-4397-9430-e1911f6944a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e68906-042d-4400-b2c4-219abdcb8087', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ede2f1b-400d-41da-bd7f-c849f14b008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:04 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Volume volume-82e68906-042d-4400-b2c4-219abdcb8087 (82e68906-042d-4400-b2c4-219abdcb8087): created successfully
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ede2f1b-400d-41da-bd7f-c849f14b008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Flow 'volume_create_manager' (f67db7bc-bd49-40e0-a3c0-054a978d7627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-299e0f4e-d5cf-4fc2-b67e-b53cb00bdd72 tempest-VolumeDependencyTests-1693638656 None] Created volume successfully.
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-43b2d42c-1f0b-4d1a-b30c-69600003dcc7-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-43b2d42c-1f0b-4d1a-b30c-69600003dcc7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-quobyte-43b2d42c-1f0b-4d1a-b30c-69600003dcc7" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-43b2d42c-1f0b-4d1a-b30c-69600003dcc7" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff666c5-a4f9-44b8-b637-c68c37aba799]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:05 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7
Sep 25 18:51:05 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Creating offline snapshot a4dfc596-e72a-4e6e-ac01-5d11d98d2697 of volume 05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd8c2c7-f75a-4d3d-8a35-8e1051eb4294]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:05 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70
Sep 25 18:51:05 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:05 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7" returned: 0 in 0.418s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:05 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7
Sep 25 18:51:05 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:05 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70" returned: 0 in 0.430s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:05 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 1G
Sep 25 18:51:05 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:05 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-43b2d42c-1f0b-4d1a-b30c-69600003dcc7" returned: 0 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-43b2d42c-1f0b-4d1a-b30c-69600003dcc7" released by "delete_volume" :: held 0.782s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Created reservations ['67e47b40-e838-48a2-91c3-6dc4e9470375', 'cc22d12c-c6fc-4589-8e31-e3b12b90e76f', '7ac434a0-2622-4f7b-99d8-2e8cd07e6f87', 'e1fe932e-02d0-43f9-b8ba-0ca9e7fa7323'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:05 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:05 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-c0f6df08-ceaf-492d-bc11-a5c64b8c292f-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-c0f6df08-ceaf-492d-bc11-a5c64b8c292f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:06 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Deleted volume successfully.
Sep 25 18:51:06 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 1G" returned: 0 in 0.685s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05300183-29e6-4cde-8a42-c766774cae70 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-quobyte-c0f6df08-ceaf-492d-bc11-a5c64b8c292f" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a4b18609-8ed0-4eae-b3f4-f9a71f356016 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-43b2d42c-1f0b-4d1a-b30c-69600003dcc7-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:06 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05300183-29e6-4cde-8a42-c766774cae70 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697
Sep 25 18:51:06 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-c0f6df08-ceaf-492d-bc11-a5c64b8c292f" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[422b626b-bc63-4522-8cf5-962211ebef10]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:06 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f
Sep 25 18:51:06 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:06 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05300183-29e6-4cde-8a42-c766774cae70 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:06 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 is being set with open permissions: ugo+rw
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:06 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697
Sep 25 18:51:06 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:06 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f" returned: 0 in 0.410s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:06 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f
Sep 25 18:51:06 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:06 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697" returned: 0 in 0.270s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:07 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info
Sep 25 18:51:07 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:07 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-c0f6df08-ceaf-492d-bc11-a5c64b8c292f" returned: 0 in 0.289s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-c0f6df08-ceaf-492d-bc11-a5c64b8c292f" released by "delete_volume" :: held 0.758s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Created reservations ['e462b73b-85d8-459f-bd1a-0d5155e71d67', '5b43f168-cc4c-433f-b4cb-98930a8268d5', 'd748bb06-ef1d-4fba-bb0b-4e5bdc3cc19d', 'b0a56793-1230-485e-b7ac-dc847f83469b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:07 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:07 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:07 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info" returned: 0 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:07 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info is being set with open permissions: ugo+rw
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:07 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info
Sep 25 18:51:07 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-b540d209-3f7d-4010-a160-639d64b2717a-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-b540d209-3f7d-4010-a160-639d64b2717a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "cinder-quobyte-b540d209-3f7d-4010-a160-639d64b2717a" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:07 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.303s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-b540d209-3f7d-4010-a160-639d64b2717a" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Deleted volume successfully.
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c903f18-303a-4eb3-b69b-1bc68279af4b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-71ed136e-6e27-4a99-8ef6-b9d9aeb0f48c tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-c0f6df08-ceaf-492d-bc11-a5c64b8c292f-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:07 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.info" returned: 0 in 0.352s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.583s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:07 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a
Sep 25 18:51:07 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Creating offline snapshot c5161de3-7d4b-4fc7-ad78-c462b44f434c of volume 82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4f724664-7dc1-47ec-9f5e-860e1f94b15a tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb07ba3-4359-4467-b9c5-c3fa096e86e3]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:07 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087
Sep 25 18:51:07 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:07 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a" returned: 0 in 0.407s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:08 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a
Sep 25 18:51:08 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:08 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087" returned: 0 in 0.405s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:08 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c 1G
Sep 25 18:51:08 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:08 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b540d209-3f7d-4010-a160-639d64b2717a" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-quobyte-b540d209-3f7d-4010-a160-639d64b2717a" released by "delete_volume" :: held 0.757s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Created reservations ['bd13a6a5-d0c8-466e-b084-a8fbd5c57d0f', 'db739c19-838c-427e-b2df-29769df3e339', '8ddf8d4e-a508-4975-995f-c60ea253a71f', '4fb7c9ad-f4d3-4f2f-8ec5-73929b8c30fd'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-a4dfc596-e72a-4e6e-ac01-5d11d98d2697-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Lock "cinder-a4dfc596-e72a-4e6e-ac01-5d11d98d2697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-05300183-29e6-4cde-8a42-c766774cae70" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-05300183-29e6-4cde-8a42-c766774cae70" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-a4dfc596-e72a-4e6e-ac01-5d11d98d2697" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-a4dfc596-e72a-4e6e-ac01-5d11d98d2697" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot a4dfc596-e72a-4e6e-ac01-5d11d98d2697 of volume 05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0bb1ad-dccf-41f0-a755-6d4ce253a061]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:08 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:08 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:08 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c 1G" returned: 0 in 0.558s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e68906-042d-4400-b2c4-219abdcb8087 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:08 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e68906-042d-4400-b2c4-219abdcb8087 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c
Sep 25 18:51:08 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:08 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697
Sep 25 18:51:08 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:08 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.311s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:08 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Deleted volume successfully.
Sep 25 18:51:08 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48efbce5-aa91-4888-836c-f2366e0033f7 tempest-CreateVolumesFromImageTest-774497831 None] Lock "cinder-b540d209-3f7d-4010-a160-639d64b2717a-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:09 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e68906-042d-4400-b2c4-219abdcb8087 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c" returned: 0 in 0.367s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:09 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c is being set with open permissions: ugo+rw
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:09 devstack sudo[107383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c
Sep 25 18:51:09 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:09 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697" returned: 0 in 0.601s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05300183-29e6-4cde-8a42-c766774cae70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[37310bcd-2e87-4f05-b025-c031f32b77b0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:09 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70
Sep 25 18:51:09 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:09 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c" returned: 0 in 0.357s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:09 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info
Sep 25 18:51:09 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:09 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70" returned: 0 in 0.500s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:09 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697
Sep 25 18:51:09 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:09 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info" returned: 0 in 0.337s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:09 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info is being set with open permissions: ugo+rw
Sep 25 18:51:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:09 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info
Sep 25 18:51:09 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:10 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.info" returned: 0 in 0.280s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:10 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697" returned: 0 in 0.488s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-bfb132c6-9943-416b-81ac-0a80d12c1b66 tempest-VolumeDependencyTests-1693638656 None] Create snapshot completed successfully
Sep 25 18:51:10 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697
Sep 25 18:51:10 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:10 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70.a4dfc596-e72a-4e6e-ac01-5d11d98d2697" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-a4dfc596-e72a-4e6e-ac01-5d11d98d2697" released by "_delete_snapshot" :: held 2.053s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-05300183-29e6-4cde-8a42-c766774cae70" released by "delete_snapshot" :: held 2.088s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Created reservations ['cd2bc9ea-022a-4f98-8c38-2a34f355f534', '417c8522-821a-4444-be64-09cea1a6e2cd', 'b9d456ef-2f78-43d1-92b0-833c30b584c5', 'f6f6a28b-b39e-4e8c-8e94-827996a50e87'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:10 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:51:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-240c21f7-1434-470f-888b-270324fe7a11 tempest-ProjectMemberTests-502303593 None] Lock "cinder-a4dfc596-e72a-4e6e-ac01-5d11d98d2697-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-05300183-29e6-4cde-8a42-c766774cae70-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Lock "cinder-05300183-29e6-4cde-8a42-c766774cae70-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-05300183-29e6-4cde-8a42-c766774cae70" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-05300183-29e6-4cde-8a42-c766774cae70" acquired by "delete_volume" :: waited 0.034s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed312a8d-daf5-4938-86fe-dd57b1600cbd]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:11 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Flow 'volume_create_manager' (c6ebb3e9-a243-41e7-aa38-702d77bfa73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6da6669-0c01-4cb8-8b03-69d2241dccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6da6669-0c01-4cb8-8b03-69d2241dccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1476981910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c430833-9f10-4c6f-b47a-8a8894b24ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c81e214b7248c481a39921752c8145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c5161de3-7d4b-4fc7-ad78-c462b44f434c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:12Z,use_quota=True,user_id='004761138d0e473ca06281f32c0b05b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a29fc8-1af0-4c10-9775-fcaaeba9f498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a29fc8-1af0-4c10-9775-fcaaeba9f498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd193a0e-f3b1-4353-9b25-52658611d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd193a0e-f3b1-4353-9b25-52658611d010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c430833-9f10-4c6f-b47a-8a8894b24ca9', 'volume_name': 'volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9', 'volume_size': 1, 'snapshot_id': 'c5161de3-7d4b-4fc7-ad78-c462b44f434c'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d14cfa-ea90-40af-8515-5e38dc80a3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d14cfa-ea90-40af-8515-5e38dc80a3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5e21ef-fd60-43e5-987a-ef23e74b35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:12 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Volume 8c430833-9f10-4c6f-b47a-8a8894b24ca9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9', 'volume_size': 1, 'snapshot_id': 'c5161de3-7d4b-4fc7-ad78-c462b44f434c'}
Sep 25 18:51:12 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70
Sep 25 18:51:12 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-quobyte-c5161de3-7d4b-4fc7-ad78-c462b44f434c-8c430833-9f10-4c6f-b47a-8a8894b24ca9" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-c5161de3-7d4b-4fc7-ad78-c462b44f434c-8c430833-9f10-4c6f-b47a-8a8894b24ca9" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Creating volume 8c430833-9f10-4c6f-b47a-8a8894b24ca9 from snapshot c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-quobyte-8c430833-9f10-4c6f-b47a-8a8894b24ca9" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-8c430833-9f10-4c6f-b47a-8a8894b24ca9" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] snapshot: c5161de3-7d4b-4fc7-ad78-c462b44f434c, volume: 8c430833-9f10-4c6f-b47a-8a8894b24ca9,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2805d1a-b8a8-4ce5-a6be-b4b75a898dad]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:12 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c
Sep 25 18:51:12 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:12 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70" returned: 0 in 0.521s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:12 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70
Sep 25 18:51:12 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:12 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c" returned: 0 in 0.467s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e68906-042d-4400-b2c4-219abdcb8087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef426ceb-204b-4b21-bd02-de452ca2cdab]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:12 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-05300183-29e6-4cde-8a42-c766774cae70" returned: 0 in 0.344s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-05300183-29e6-4cde-8a42-c766774cae70" released by "delete_volume" :: held 0.960s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:12 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087
Sep 25 18:51:12 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Created reservations ['54843b02-c34a-403c-bfa2-6e278123e0f9', '307abfd4-7184-4d10-9f07-919112e9aef3', '74945e80-1d58-4c4f-8b8a-192671e82a82', 'e9404d04-ed0e-4e73-9dfc-1b89257ecf3a'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:13 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:13 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:13 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087" returned: 0 in 0.470s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:13 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9
Sep 25 18:51:13 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:13 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.363s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:13 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-688871c3-25a3-4379-837f-91f1b057bd7e tempest-ProjectMemberTests-502303593 None] Lock "cinder-05300183-29e6-4cde-8a42-c766774cae70-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (3ba521cd-c1e3-438a-b309-c2237dcb5771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fb0d61-5af4-4597-82bb-58d64aabc413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fb0d61-5af4-4597-82bb-58d64aabc413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756609472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d23293b-3355-4058-844f-2e18f037ccf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:14Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b878059-6149-4b92-b485-dbf4be786e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b878059-6149-4b92-b485-dbf4be786e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d556d52-b210-4264-bba9-7803a8179634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d556d52-b210-4264-bba9-7803a8179634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d23293b-3355-4058-844f-2e18f037ccf8', 'volume_name': 'volume-9d23293b-3355-4058-844f-2e18f037ccf8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2c7532-44b6-45cd-b004-70c63be521ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2c7532-44b6-45cd-b004-70c63be521ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d74500-6e90-4877-a81b-199c3931d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:13 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Volume 9d23293b-3355-4058-844f-2e18f037ccf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d23293b-3355-4058-844f-2e18f037ccf8', 'volume_size': 1}
Sep 25 18:51:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:21 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9" returned: 0 in 8.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:51:21 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Converted 1024.00 MB image at 123.15 MB/s
Sep 25 18:51:21 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 is being set with open permissions: ugo+rw
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:21 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9
Sep 25 18:51:21 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:21 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-8c430833-9f10-4c6f-b47a-8a8894b24ca9" released by "_copy_volume_from_snapshot" :: held 9.675s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-c5161de3-7d4b-4fc7-ad78-c462b44f434c-8c430833-9f10-4c6f-b47a-8a8894b24ca9" released by "_create_volume_from_snapshot" :: held 9.773s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.800s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.111s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756609472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d23293b-3355-4058-844f-2e18f037ccf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:14Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Creating volume 9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:21 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:21 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 1073741824
Sep 25 18:51:21 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5e21ef-fd60-43e5-987a-ef23e74b35a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9', 'volume_size': 1, 'snapshot_id': 'c5161de3-7d4b-4fc7-ad78-c462b44f434c'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617bd2f-ee14-4f60-bc6d-5a9e4ad1ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:22 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Volume volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 (8c430833-9f10-4c6f-b47a-8a8894b24ca9): created successfully
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617bd2f-ee14-4f60-bc6d-5a9e4ad1ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Flow 'volume_create_manager' (c6ebb3e9-a243-41e7-aa38-702d77bfa73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8504d259-d6b3-466f-9387-46085c5fda35 tempest-VolumeDependencyTests-1693638656 None] Created volume successfully.
Sep 25 18:51:22 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 1073741824" returned: 0 in 0.504s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:22 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8
Sep 25 18:51:22 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:22 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8" returned: 0 in 0.285s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d74500-6e90-4877-a81b-199c3931d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d23293b-3355-4058-844f-2e18f037ccf8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a266fc-2a79-43ef-beef-57380aecedbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:22 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Volume volume-9d23293b-3355-4058-844f-2e18f037ccf8 (9d23293b-3355-4058-844f-2e18f037ccf8): created successfully
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a266fc-2a79-43ef-beef-57380aecedbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:22 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (3ba521cd-c1e3-438a-b309-c2237dcb5771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:22 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a1c4755c-027c-41b5-ae21-ea9b3f23cc1b tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-c5161de3-7d4b-4fc7-ad78-c462b44f434c-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-c5161de3-7d4b-4fc7-ad78-c462b44f434c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-quobyte-82e68906-042d-4400-b2c4-219abdcb8087" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-82e68906-042d-4400-b2c4-219abdcb8087" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-quobyte-c5161de3-7d4b-4fc7-ad78-c462b44f434c" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-c5161de3-7d4b-4fc7-ad78-c462b44f434c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Deleting offline snapshot c5161de3-7d4b-4fc7-ad78-c462b44f434c of volume 82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] snapshot_file for this snap is: volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e75e4a-2bf0-4b00-a81a-a02db931f6d8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:23 devstack sudo[107454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c
Sep 25 18:51:23 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:23 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c" returned: 0 in 0.426s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e68906-042d-4400-b2c4-219abdcb8087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a7853-1fc5-4c51-ab50-5b289fba0d6e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:23 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087
Sep 25 18:51:23 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:23 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Creating offline snapshot 9b76e164-ed5f-4494-b6be-6a41ca9f1829 of volume 9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ca3f1-61ff-4ddc-b6aa-7c79f96f7d32]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:24 devstack sudo[107461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8
Sep 25 18:51:24 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:24 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087" returned: 0 in 0.759s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:24 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c
Sep 25 18:51:24 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:24 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8" returned: 0 in 0.504s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:24 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 1G
Sep 25 18:51:24 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:24 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c" returned: 0 in 0.458s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:24 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c
Sep 25 18:51:24 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:25 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 1G" returned: 0 in 0.677s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d23293b-3355-4058-844f-2e18f037ccf8 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:25 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d23293b-3355-4058-844f-2e18f037ccf8 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829
Sep 25 18:51:25 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:25 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087.c5161de3-7d4b-4fc7-ad78-c462b44f434c" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-c5161de3-7d4b-4fc7-ad78-c462b44f434c" released by "_delete_snapshot" :: held 2.195s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-82e68906-042d-4400-b2c4-219abdcb8087" released by "delete_snapshot" :: held 2.231s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Created reservations ['be1787eb-f557-401c-aa33-8e466f944c8f', 'a5514ed9-de86-4d19-bca6-5f0263ed54c5', 'ede8496e-1145-423f-b3e8-efe20057d7cd', '4a0b6f46-83a7-4110-a3d6-cbb364c0f74c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Delete snapshot completed successfully.
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-85bd62e2-b62c-454c-97bd-c723135723b0 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-c5161de3-7d4b-4fc7-ad78-c462b44f434c-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:25 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d23293b-3355-4058-844f-2e18f037ccf8 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829" returned: 0 in 0.442s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:25 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 is being set with open permissions: ugo+rw
Sep 25 18:51:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:25 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829
Sep 25 18:51:25 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:26 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829" returned: 0 in 0.380s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:26 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info
Sep 25 18:51:26 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-82e68906-042d-4400-b2c4-219abdcb8087-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:26 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info" returned: 0 in 0.301s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:26 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info is being set with open permissions: ugo+rw
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-82e68906-042d-4400-b2c4-219abdcb8087-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:26 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info
Sep 25 18:51:26 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-quobyte-82e68906-042d-4400-b2c4-219abdcb8087" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-82e68906-042d-4400-b2c4-219abdcb8087" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcee669-c9ba-4663-8956-75335e457325]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:26 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087
Sep 25 18:51:26 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:26 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.info" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-63ddd60f-f0a1-462d-ae92-c6bf2ad35858 tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:51:27 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087" returned: 0 in 0.393s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:27 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087
Sep 25 18:51:27 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-9b76e164-ed5f-4494-b6be-6a41ca9f1829-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Lock "cinder-9b76e164-ed5f-4494-b6be-6a41ca9f1829-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-9d23293b-3355-4058-844f-2e18f037ccf8" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-9d23293b-3355-4058-844f-2e18f037ccf8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-9b76e164-ed5f-4494-b6be-6a41ca9f1829" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-9b76e164-ed5f-4494-b6be-6a41ca9f1829" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot 9b76e164-ed5f-4494-b6be-6a41ca9f1829 of volume 9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adecd90-c6ca-4cee-8e7f-d859c1627fe8]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:27 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829
Sep 25 18:51:27 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:27 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-82e68906-042d-4400-b2c4-219abdcb8087" returned: 0 in 0.541s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-82e68906-042d-4400-b2c4-219abdcb8087" released by "delete_volume" :: held 1.078s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Created reservations ['fcefba63-9ead-4921-ac8e-13e93f578868', 'f1dc30f5-debf-4dbc-aa7d-b53b0d6a7c2f', '88c51d70-abb3-415c-a970-2504e2936c25', 'c5ff26c5-6c8f-4fc4-bda4-f968b1999d20'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:27 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:27 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:27 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829" returned: 0 in 0.550s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:27 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d23293b-3355-4058-844f-2e18f037ccf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0660579-7158-4ce1-a428-59f2ccb8636f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:28 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8
Sep 25 18:51:28 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (c98f368f-555e-4e52-83a9-2af4d6a7a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba9c445-8053-41ae-9869-79532156bf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba9c445-8053-41ae-9869-79532156bf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47047536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f1bd0d-314c-413e-9f04-6469240c94ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:28Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ea171f-621c-490e-bdd3-2e1ef00cb835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ea171f-621c-490e-bdd3-2e1ef00cb835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:28 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f8c5a6-525b-42e1-a5c8-52a382ba470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f8c5a6-525b-42e1-a5c8-52a382ba470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f1bd0d-314c-413e-9f04-6469240c94ec', 'volume_name': 'volume-96f1bd0d-314c-413e-9f04-6469240c94ec', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9502d417-f387-44bb-8334-afd7d694d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9502d417-f387-44bb-8334-afd7d694d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb5f93b-0dcf-4eba-a8c0-6532a996e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:28 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Volume 96f1bd0d-314c-413e-9f04-6469240c94ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f1bd0d-314c-413e-9f04-6469240c94ec', 'volume_size': 1}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47047536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f1bd0d-314c-413e-9f04-6469240c94ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:28Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Creating volume 96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:28 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.437s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Deleted volume successfully.
Sep 25 18:51:28 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec 1073741824
Sep 25 18:51:28 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=220,cinder:INSERT=77,cinder:UPDATE=289,cinder:DELETE=27 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8f4ee3ff-3546-4e33-9db2-0540b80e54d3 tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-82e68906-042d-4400-b2c4-219abdcb8087-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:28 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8" returned: 0 in 0.547s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:28 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829
Sep 25 18:51:28 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-8c430833-9f10-4c6f-b47a-8a8894b24ca9-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-8c430833-9f10-4c6f-b47a-8a8894b24ca9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=296,cinder:SELECT=217,cinder:DELETE=26,cinder:INSERT=80 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "cinder-quobyte-8c430833-9f10-4c6f-b47a-8a8894b24ca9" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-8c430833-9f10-4c6f-b47a-8a8894b24ca9" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc4bc7-e2ef-4ecd-807d-c80169c25d7b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:28 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec 1073741824" returned: 0 in 0.736s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:29 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec
Sep 25 18:51:29 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:29 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829" returned: 0 in 0.615s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:29 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9
Sep 25 18:51:29 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:29 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829
Sep 25 18:51:29 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:29 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8.9b76e164-ed5f-4494-b6be-6a41ca9f1829" returned: 0 in 0.298s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:29 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-9b76e164-ed5f-4494-b6be-6a41ca9f1829" released by "_delete_snapshot" :: held 2.199s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-9d23293b-3355-4058-844f-2e18f037ccf8" released by "delete_snapshot" :: held 2.236s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb5f93b-0dcf-4eba-a8c0-6532a996e521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f1bd0d-314c-413e-9f04-6469240c94ec', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819deee6-009b-40ca-977d-b1423b163b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:29 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9" returned: 0 in 0.569s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Volume volume-96f1bd0d-314c-413e-9f04-6469240c94ec (96f1bd0d-314c-413e-9f04-6469240c94ec): created successfully
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819deee6-009b-40ca-977d-b1423b163b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (c98f368f-555e-4e52-83a9-2af4d6a7a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:29 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9
Sep 25 18:51:29 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-55af5e45-00c8-4a0f-a5e0-680f056965de tempest-ProjectReaderTests-1152304755 None] Created volume successfully.
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Created reservations ['c6eb4dfb-0121-4e43-bff2-bf8ccf795644', '1a6fd732-abd7-4398-bdb3-aee28e80db53', 'f2f68b6a-5cf6-4854-934c-a46dac62574c', '16fa58d8-27fd-49bf-bdbc-75c07d146daa'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:29 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-48a5301d-468b-4e87-9e57-a8fea4a19752 tempest-ProjectMemberTests-502303593 None] Lock "cinder-9b76e164-ed5f-4494-b6be-6a41ca9f1829-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:29 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c430833-9f10-4c6f-b47a-8a8894b24ca9" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-quobyte-8c430833-9f10-4c6f-b47a-8a8894b24ca9" released by "delete_volume" :: held 0.942s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:29 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Created reservations ['08c1a367-be37-4100-b297-9f6214708025', 'bc0d434a-92e5-427c-ba25-3380e84beff0', '31c4491b-316d-4e16-94ef-53b7c7a4f239', 'd6ffb612-8d04-44bf-837c-6d5432a113bd'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:30 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:30 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:30 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Deleted volume successfully.
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-f2e9c2c9-209a-4c93-9189-86c52482df5f tempest-VolumeDependencyTests-1693638656 None] Lock "cinder-8c430833-9f10-4c6f-b47a-8a8894b24ca9-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Creating offline snapshot edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 of volume 96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[28917cd3-02a5-4c0a-aee6-727e56d8d55e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-9d23293b-3355-4058-844f-2e18f037ccf8-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Lock "cinder-9d23293b-3355-4058-844f-2e18f037ccf8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:30 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec
Sep 25 18:51:30 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-9d23293b-3355-4058-844f-2e18f037ccf8" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-9d23293b-3355-4058-844f-2e18f037ccf8" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0328e138-21fc-4210-ac60-23fd7fa60423]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:30 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8
Sep 25 18:51:30 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:30 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec" returned: 0 in 0.455s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:30 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 1G
Sep 25 18:51:30 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:31 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8" returned: 0 in 0.556s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:31 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8
Sep 25 18:51:31 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:31 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 1G" returned: 0 in 0.662s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f1bd0d-314c-413e-9f04-6469240c94ec -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:31 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f1bd0d-314c-413e-9f04-6469240c94ec -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2
Sep 25 18:51:31 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:31 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9d23293b-3355-4058-844f-2e18f037ccf8" returned: 0 in 0.402s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-9d23293b-3355-4058-844f-2e18f037ccf8" released by "delete_volume" :: held 1.076s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Created reservations ['445d57bc-e262-4ed7-a38f-94d5d2c19843', '8e9afabd-12bd-4de7-a3cc-a79abf2f1289', '701310ef-840e-4527-8a84-c174e4be56f7', 'e97bff15-48df-4552-bb59-3f09ea929ef6'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:31 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:31 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:32 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f1bd0d-314c-413e-9f04-6469240c94ec -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" returned: 0 in 0.415s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 is being set with open permissions: ugo+rw
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:32 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2
Sep 25 18:51:32 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:32 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.299s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:32 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-96ceeb93-2a02-4724-a625-001bcd09c67c tempest-ProjectMemberTests-502303593 None] Lock "cinder-9d23293b-3355-4058-844f-2e18f037ccf8-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:32 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" returned: 0 in 0.326s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:32 devstack sudo[107581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info
Sep 25 18:51:32 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:32 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info" returned: 0 in 0.292s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info is being set with open permissions: ugo+rw
Sep 25 18:51:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:32 devstack sudo[107584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info
Sep 25 18:51:32 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:33 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.info" returned: 0 in 0.339s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:33 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-2eb9066f-fa17-48fb-9c8e-83aa141dbe62 tempest-ProjectReaderTests-1152304755 None] Create snapshot completed successfully
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (2619929a-dfc3-44ff-ac9c-96544c873c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e0f8d2-5bf0-49fa-881a-baaf17110f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e0f8d2-5bf0-49fa-881a-baaf17110f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246621047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f36239-b525-4888-a4d1-7a8696222729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:33Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a321f1a0-43ee-4354-988c-3ccf5583b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a321f1a0-43ee-4354-988c-3ccf5583b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2796b0-4baa-4315-89c9-a515820639ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2796b0-4baa-4315-89c9-a515820639ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f36239-b525-4888-a4d1-7a8696222729', 'volume_name': 'volume-36f36239-b525-4888-a4d1-7a8696222729', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7533a400-e210-4277-b930-d28e56892390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7533a400-e210-4277-b930-d28e56892390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ebbca9-1ad9-4c57-afa2-92499db4e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:33 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Volume 36f36239-b525-4888-a4d1-7a8696222729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f36239-b525-4888-a4d1-7a8696222729', 'volume_size': 1}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246621047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f36239-b525-4888-a4d1-7a8696222729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:33Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Creating volume 36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:33 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:33 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 1073741824
Sep 25 18:51:33 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-edd2ce77-f39c-4ac6-81ef-66ec8d424ba2-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-edd2ce77-f39c-4ac6-81ef-66ec8d424ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-96f1bd0d-314c-413e-9f04-6469240c94ec" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-96f1bd0d-314c-413e-9f04-6469240c94ec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Deleting offline snapshot edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 of volume 96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] snapshot_file for this snap is: volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e4e23-a5bc-42a1-b337-1662fdfc427e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:34 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 1073741824" returned: 0 in 0.629s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:34 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2
Sep 25 18:51:34 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:34 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729
Sep 25 18:51:34 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:34 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729" returned: 0 in 0.325s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ebbca9-1ad9-4c57-afa2-92499db4e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f36239-b525-4888-a4d1-7a8696222729', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab81fb-8b36-4ee4-b81e-37e17358d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:34 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:34 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Volume volume-36f36239-b525-4888-a4d1-7a8696222729 (36f36239-b525-4888-a4d1-7a8696222729): created successfully
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab81fb-8b36-4ee4-b81e-37e17358d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (2619929a-dfc3-44ff-ac9c-96544c873c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" returned: 0 in 0.521s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f1bd0d-314c-413e-9f04-6469240c94ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9ef84d-91a5-4038-810b-9a58138e3b11]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:34 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c40ea29f-a7cc-452c-bed1-8059b4839753 tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:51:34 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec
Sep 25 18:51:34 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:35 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec" returned: 0 in 0.518s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:35 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2
Sep 25 18:51:35 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:35 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" returned: 0 in 0.541s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:35 devstack sudo[107648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2
Sep 25 18:51:35 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Creating offline snapshot 19205845-8107-423a-bb8b-17ca145f732c of volume 36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80c28b-1dc3-44f6-9bbf-99098ee141c0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:35 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729
Sep 25 18:51:35 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:36 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec.edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-edd2ce77-f39c-4ac6-81ef-66ec8d424ba2" released by "_delete_snapshot" :: held 2.065s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-96f1bd0d-314c-413e-9f04-6469240c94ec" released by "delete_snapshot" :: held 2.098s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Created reservations ['be1f1636-3b8e-4313-97e7-7e0bfa294cab', 'ecb42eac-f41f-4593-af07-0bac94012286', '265e5c29-22cf-415e-8f54-ebf7c9291864', '5a948102-c6c4-43dc-8dd6-0ed7c87f4c29'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Delete snapshot completed successfully.
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbebd76a-39ec-4f11-b213-701e9a4aac92 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-edd2ce77-f39c-4ac6-81ef-66ec8d424ba2-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:36 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729" returned: 0 in 0.528s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:36 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c 1G
Sep 25 18:51:36 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Flow 'volume_create_manager' (8a80fffd-b4a8-4e0f-8f9e-fa8b97f996f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fe94f0-208e-42ae-8567-c35dec21d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fe94f0-208e-42ae-8567-c35dec21d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010450523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8957161af02146179503c1d34c4d21d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:36Z,use_quota=True,user_id='0b99e5b7b2be4f08b31502b0fe1f378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefdd23a-ad5f-4d7e-b40a-dc940d4f7188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefdd23a-ad5f-4d7e-b40a-dc940d4f7188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d67f31-5cd9-47e4-8ecc-e6e70b42282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d67f31-5cd9-47e4-8ecc-e6e70b42282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9', 'volume_name': 'volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7c8cb2-475f-4314-b80d-2b6ca76de492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7c8cb2-475f-4314-b80d-2b6ca76de492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ce0c6-51e4-49c6-93cf-c55cdd809a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:36 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Volume 1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9', 'volume_size': 1}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:36 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c 1G" returned: 0 in 0.452s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f36239-b525-4888-a4d1-7a8696222729 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:36 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f36239-b525-4888-a4d1-7a8696222729 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c
Sep 25 18:51:36 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:37 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f36239-b525-4888-a4d1-7a8696222729 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c" returned: 0 in 0.304s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:37 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c is being set with open permissions: ugo+rw
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:37 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c
Sep 25 18:51:37 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-96f1bd0d-314c-413e-9f04-6469240c94ec-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-96f1bd0d-314c-413e-9f04-6469240c94ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-96f1bd0d-314c-413e-9f04-6469240c94ec" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-96f1bd0d-314c-413e-9f04-6469240c94ec" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c97607-be6a-4cf5-ba29-3c0794332ed4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:37 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c" returned: 0 in 0.308s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:37 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info
Sep 25 18:51:37 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:37 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec
Sep 25 18:51:37 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:37 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:37 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info is being set with open permissions: ugo+rw
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:37 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info
Sep 25 18:51:37 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:37 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec" returned: 0 in 0.426s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:37 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec
Sep 25 18:51:37 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:38 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.info" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010450523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8957161af02146179503c1d34c4d21d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:36Z,use_quota=True,user_id='0b99e5b7b2be4f08b31502b0fe1f378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Creating volume 1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:38 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:38 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 1073741824
Sep 25 18:51:38 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:38 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-96f1bd0d-314c-413e-9f04-6469240c94ec" returned: 0 in 0.341s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-105a8728-b261-46ff-be91-91b0af202f92 tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-96f1bd0d-314c-413e-9f04-6469240c94ec" released by "delete_volume" :: held 0.859s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Created reservations ['494ce668-a64f-401e-9ff0-e915155e98f8', '388d7130-f39e-4f4f-a9e3-5867c06b6542', 'eef128c4-979b-4c86-8df3-dd40db703d7e', 'f4a23f8a-f3a0-4d10-952c-a9054ca4f4cd'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:38 devstack sudo[107687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:38 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:38 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Deleted volume successfully.
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ca8eb992-08d7-4a0c-9094-0d01033f64e5 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-96f1bd0d-314c-413e-9f04-6469240c94ec-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:38 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 1073741824" returned: 0 in 0.750s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:38 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9
Sep 25 18:51:38 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-19205845-8107-423a-bb8b-17ca145f732c-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Lock "cinder-19205845-8107-423a-bb8b-17ca145f732c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-36f36239-b525-4888-a4d1-7a8696222729" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-36f36239-b525-4888-a4d1-7a8696222729" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-19205845-8107-423a-bb8b-17ca145f732c" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-19205845-8107-423a-bb8b-17ca145f732c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot 19205845-8107-423a-bb8b-17ca145f732c of volume 36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:39 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[75217c7f-66fb-4ede-a42d-5eadc5d437d0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ce0c6-51e4-49c6-93cf-c55cdd809a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa44080-4534-4582-bb3d-862b61f8a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (afe616cb-5952-4826-8e77-37529ee1462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1246be41-0a42-4d97-9bf2-0c8deca061b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:39 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Volume volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 (1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9): created successfully
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa44080-4534-4582-bb3d-862b61f8a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Flow 'volume_create_manager' (8a80fffd-b4a8-4e0f-8f9e-fa8b97f996f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1246be41-0a42-4d97-9bf2-0c8deca061b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144983857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44708f4c-97e0-4832-ad57-1b9bebfa8ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:39Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f03f598-10a8-4fbb-a15a-4e557d18e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f03f598-10a8-4fbb-a15a-4e557d18e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c38d6a1-2aa9-407d-b494-b2d25a047017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c38d6a1-2aa9-407d-b494-b2d25a047017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44708f4c-97e0-4832-ad57-1b9bebfa8ba7', 'volume_name': 'volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:39 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c
Sep 25 18:51:39 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f077dcd8-3392-454d-94c8-f0e3a685a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f077dcd8-3392-454d-94c8-f0e3a685a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d335fc41-6243-4d5b-a6a8-520fda52f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:39 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Volume 44708f4c-97e0-4832-ad57-1b9bebfa8ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7', 'volume_size': 1}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144983857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44708f4c-97e0-4832-ad57-1b9bebfa8ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:39Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Creating volume 44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:39 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:39 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f3514f72-e86b-4521-9555-5f2bbe5cfc7d tempest-ProjectReaderTests-407713932 None] Created volume successfully.
Sep 25 18:51:39 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 1073741824
Sep 25 18:51:39 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:39 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c" returned: 0 in 0.497s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f36239-b525-4888-a4d1-7a8696222729(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f10e44-db7b-4c08-8325-c98874e640ce]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Acquiring lock "cinder-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Lock "cinder-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Acquiring lock "cinder-quobyte-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Lock "cinder-quobyte-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9" acquired by "delete_volume" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4128b6-7d0e-4cc7-99f7-9c9368610dbe]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:39 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 1073741824" returned: 0 in 0.595s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:39 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729
Sep 25 18:51:39 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:40 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9
Sep 25 18:51:40 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:40 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7
Sep 25 18:51:40 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:40 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729" returned: 0 in 0.562s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:40 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c
Sep 25 18:51:40 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:40 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:40 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9" returned: 0 in 0.472s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" returned: 0 in 0.377s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d335fc41-6243-4d5b-a6a8-520fda52f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:40 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9
Sep 25 18:51:40 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bd2d33-4948-43d1-95b0-a878b9d31b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:40 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Volume volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 (44708f4c-97e0-4832-ad57-1b9bebfa8ba7): created successfully
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bd2d33-4948-43d1-95b0-a878b9d31b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (afe616cb-5952-4826-8e77-37529ee1462b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ea7d2cbe-b82b-40d8-a94e-77819927e8cc tempest-ProjectReaderTests-1152304755 None] Created volume successfully.
Sep 25 18:51:40 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c" returned: 0 in 0.409s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:40 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9" returned: 0 in 0.360s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:40 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c
Sep 25 18:51:40 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Lock "cinder-quobyte-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9" released by "delete_volume" :: held 0.895s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Created reservations ['b1c637f2-c89c-4cb3-aac4-37a661661a55', 'c6dfddb5-ba18-4b65-bf58-e5b15ce25f52', '882e84bf-20e6-4a87-aa57-f44ae099fe5c', '250f043d-2967-4445-b34d-d2bc8c13f9ac'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:40 devstack sudo[107743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:40 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:41 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729.19205845-8107-423a-bb8b-17ca145f732c" returned: 0 in 0.296s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-19205845-8107-423a-bb8b-17ca145f732c" released by "_delete_snapshot" :: held 1.924s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-36f36239-b525-4888-a4d1-7a8696222729" released by "delete_snapshot" :: held 1.977s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Created reservations ['5e03c2e5-922f-4ad4-bfee-c2470ce4cbae', 'aebe16ee-b223-4e30-9e7e-6c57713e3e97', '40389c64-ffbb-48f6-ad8d-34264bf5d6c0', 'd55ab00c-fd04-4274-9f17-62c01eb10f97'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:41 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.399s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Deleted volume successfully.
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-089b2b9f-64fa-45df-ae8c-ee970121578a tempest-ProjectReaderTests-407713932 None] Lock "cinder-1308c1f1-683d-4bf5-ae56-2f2ddbc23bd9-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:41 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ac6a1a3f-c5a2-4f1d-8288-fe5a0b4452e8 tempest-ProjectMemberTests-502303593 None] Lock "cinder-19205845-8107-423a-bb8b-17ca145f732c-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Creating offline snapshot 21b48936-d350-48f1-84ac-783b4e8627c4 of volume 44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Flow 'volume_create_manager' (65c70635-b998-4b63-bfda-639e959cac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663de59c-1bbb-4097-b391-754c9d76d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdb577e-2040-4eb8-82a8-19622e88df6a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663de59c-1bbb-4097-b391-754c9d76d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383620022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c62be13-e8f3-41e3-ac33-4966f348aefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8957161af02146179503c1d34c4d21d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:42Z,use_quota=True,user_id='0b99e5b7b2be4f08b31502b0fe1f378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf865ae-258f-4273-91f2-c26ad68c0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf865ae-258f-4273-91f2-c26ad68c0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c7049f-b48e-4952-bfd3-9cb718415305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c7049f-b48e-4952-bfd3-9cb718415305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c62be13-e8f3-41e3-ac33-4966f348aefa', 'volume_name': 'volume-8c62be13-e8f3-41e3-ac33-4966f348aefa', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cb3478-263d-4a24-8c59-07b7e0797c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09cb3478-263d-4a24-8c59-07b7e0797c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d147edf5-fa9d-4751-bcc6-de959c3ce712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:41 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Volume 8c62be13-e8f3-41e3-ac33-4966f348aefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c62be13-e8f3-41e3-ac33-4966f348aefa', 'volume_size': 1}
Sep 25 18:51:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:41 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7
Sep 25 18:51:41 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:42 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" returned: 0 in 0.390s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:42 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 1G
Sep 25 18:51:42 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-36f36239-b525-4888-a4d1-7a8696222729-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Lock "cinder-36f36239-b525-4888-a4d1-7a8696222729-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-36f36239-b525-4888-a4d1-7a8696222729" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-36f36239-b525-4888-a4d1-7a8696222729" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d63bf52-3ade-407b-bd2f-2202f266910c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:42 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729
Sep 25 18:51:42 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:42 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 1G" returned: 0 in 0.536s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:42 devstack sudo[107760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4
Sep 25 18:51:42 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:42 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729" returned: 0 in 0.450s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:42 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729
Sep 25 18:51:42 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:43 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4" returned: 0 in 0.345s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:43 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 is being set with open permissions: ugo+rw
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:43 devstack sudo[107770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4
Sep 25 18:51:43 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:43 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-36f36239-b525-4888-a4d1-7a8696222729" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-36f36239-b525-4888-a4d1-7a8696222729" released by "delete_volume" :: held 0.817s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Created reservations ['d5f07269-5b0d-40d7-bb91-b047096c18f0', 'c01935ab-5fec-495f-a1f9-adbb79c93868', 'cde0c867-1aaf-4390-9e7b-c565e48668f5', '0b97aac0-f07c-4171-b400-abe6c5f42496'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:43 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:43 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:43 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4" returned: 0 in 0.279s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:43 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info
Sep 25 18:51:43 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:43 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a5d335bb-ed74-4e0f-b7ce-d7bb6e296ecb tempest-ProjectMemberTests-502303593 None] Lock "cinder-36f36239-b525-4888-a4d1-7a8696222729-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:43 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info" returned: 0 in 0.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:43 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info is being set with open permissions: ugo+rw
Sep 25 18:51:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:43 devstack sudo[107780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info
Sep 25 18:51:43 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:44 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.info" returned: 0 in 0.289s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383620022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c62be13-e8f3-41e3-ac33-4966f348aefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8957161af02146179503c1d34c4d21d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:42Z,use_quota=True,user_id='0b99e5b7b2be4f08b31502b0fe1f378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Creating volume 8c62be13-e8f3-41e3-ac33-4966f348aefa {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:44 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:44 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa 1073741824
Sep 25 18:51:44 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (751fad14-7126-4621-8198-7155e6bd770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b874b186-7d90-4532-b9db-200be793896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e2524cf5-061c-494f-8431-d06011d1e777 tempest-ProjectReaderTests-1152304755 None] Create snapshot completed successfully
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b874b186-7d90-4532-b9db-200be793896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923037103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41b4eea-a683-4f41-973e-7c69eca7d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:44Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3043b5-b295-47a7-b91a-9b477294435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3043b5-b295-47a7-b91a-9b477294435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22d4ff1-1dc3-4cce-918d-9c264386f820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22d4ff1-1dc3-4cce-918d-9c264386f820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41b4eea-a683-4f41-973e-7c69eca7d77c', 'volume_name': 'volume-e41b4eea-a683-4f41-973e-7c69eca7d77c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf013b71-aa1f-4f26-889c-4b229f0bd11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf013b71-aa1f-4f26-889c-4b229f0bd11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0122462-b268-4caf-bcea-0513d1a5b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:44 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Volume e41b4eea-a683-4f41-973e-7c69eca7d77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41b4eea-a683-4f41-973e-7c69eca7d77c', 'volume_size': 1}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:44 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:44 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:44 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.286s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:51:44 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa 1073741824" returned: 0 in 0.509s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:44 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa
Sep 25 18:51:44 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-21b48936-d350-48f1-84ac-783b4e8627c4-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-21b48936-d350-48f1-84ac-783b4e8627c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-21b48936-d350-48f1-84ac-783b4e8627c4" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-21b48936-d350-48f1-84ac-783b4e8627c4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Deleting offline snapshot 21b48936-d350-48f1-84ac-783b4e8627c4 of volume 44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] snapshot_file for this snap is: volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8f12a-13d9-409a-9c91-f8b55c679e21]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:45 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa" returned: 0 in 0.374s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923037103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41b4eea-a683-4f41-973e-7c69eca7d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:44Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Creating volume e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:45 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d147edf5-fa9d-4751-bcc6-de959c3ce712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c62be13-e8f3-41e3-ac33-4966f348aefa', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca2f77f-d060-4d9a-b497-20d55c50c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:45 devstack sudo[107796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c 1073741824
Sep 25 18:51:45 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Volume volume-8c62be13-e8f3-41e3-ac33-4966f348aefa (8c62be13-e8f3-41e3-ac33-4966f348aefa): created successfully
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca2f77f-d060-4d9a-b497-20d55c50c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Flow 'volume_create_manager' (65c70635-b998-4b63-bfda-639e959cac39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:45 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4
Sep 25 18:51:45 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:45 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-17e7a599-18be-4eaf-8590-6af9725c92ff tempest-ProjectReaderTests-407713932 None] Created volume successfully.
Sep 25 18:51:45 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4" returned: 0 in 0.498s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f416f2-2d03-4e31-9e8c-2a1eca27629c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:45 devstack sudo[107807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7
Sep 25 18:51:45 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:45 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c 1073741824" returned: 0 in 0.607s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:45 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c
Sep 25 18:51:45 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Acquiring lock "cinder-8c62be13-e8f3-41e3-ac33-4966f348aefa-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Lock "cinder-8c62be13-e8f3-41e3-ac33-4966f348aefa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:45 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:46 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Acquiring lock "cinder-quobyte-8c62be13-e8f3-41e3-ac33-4966f348aefa" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c" returned: 0 in 0.322s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:46 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4
Sep 25 18:51:46 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0122462-b268-4caf-bcea-0513d1a5b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41b4eea-a683-4f41-973e-7c69eca7d77c', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005e14b4-eef7-4de8-9372-9e12c8df72b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Lock "cinder-quobyte-8c62be13-e8f3-41e3-ac33-4966f348aefa" acquired by "delete_volume" :: waited 0.043s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Volume volume-e41b4eea-a683-4f41-973e-7c69eca7d77c (e41b4eea-a683-4f41-973e-7c69eca7d77c): created successfully
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005e14b4-eef7-4de8-9372-9e12c8df72b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (751fad14-7126-4621-8198-7155e6bd770e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae7d438-749a-4459-aa56-3277653e722c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-dbe1f248-2c3a-4bea-8bcc-9a14e0e71e2e tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:51:46 devstack sudo[107818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa
Sep 25 18:51:46 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Flow 'volume_create_manager' (e9f39bef-e2dd-4e92-8fff-9a86f20a3c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcae1a6-4dda-4566-8bd7-9e4862d7611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fcae1a6-4dda-4566-8bd7-9e4862d7611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1055112878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592bf5d3-3dd8-411a-bc6e-b612b4bae132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd572d3da804d9f85b36ba57e332f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:46Z,use_quota=True,user_id='8c5c81eb9f4d48b6a1f2e0435a3be816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7a712d-f6a1-4fd4-90e6-ef7b8a49015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7a712d-f6a1-4fd4-90e6-ef7b8a49015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c56924-a757-4a0f-9cb4-903b3e0e8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c56924-a757-4a0f-9cb4-903b3e0e8e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592bf5d3-3dd8-411a-bc6e-b612b4bae132', 'volume_name': 'volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a285ae9-c913-4419-8705-c823965d0693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a285ae9-c913-4419-8705-c823965d0693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726c7245-d005-44bf-b98b-cac6116fffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Volume 592bf5d3-3dd8-411a-bc6e-b612b4bae132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132', 'volume_size': 1}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1055112878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592bf5d3-3dd8-411a-bc6e-b612b4bae132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd572d3da804d9f85b36ba57e332f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:46Z,use_quota=True,user_id='8c5c81eb9f4d48b6a1f2e0435a3be816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Creating volume 592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:46 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:46 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4" returned: 0 in 0.447s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:46 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 1073741824
Sep 25 18:51:46 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:46 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4
Sep 25 18:51:46 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:46 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa" returned: 0 in 0.422s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:46 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa
Sep 25 18:51:46 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:46 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7.21b48936-d350-48f1-84ac-783b4e8627c4" returned: 0 in 0.258s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-21b48936-d350-48f1-84ac-783b4e8627c4" released by "_delete_snapshot" :: held 1.818s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" released by "delete_snapshot" :: held 1.850s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Created reservations ['76da075d-85dc-4d1e-b2ba-e384bb138d65', '6b514ef8-8a63-4a51-96e4-b08e25c3220c', '975c9e9f-f55c-48c1-b655-76eb4a14b576', '0f818d07-896a-4aa1-8d53-c0820c702a66'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:46 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8c62be13-e8f3-41e3-ac33-4966f348aefa" returned: 0 in 0.281s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Lock "cinder-quobyte-8c62be13-e8f3-41e3-ac33-4966f348aefa" released by "delete_volume" :: held 0.781s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Delete snapshot completed successfully.
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-ef4edc93-c247-4a33-af61-0bf28d250549 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-21b48936-d350-48f1-84ac-783b4e8627c4-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:46 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 1073741824" returned: 0 in 0.468s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Created reservations ['aed38be1-b65d-49a0-a0a1-5a0ae7eeac33', '0cfa8f19-6230-4d40-a083-e3aea63e8621', '90a25ea1-698a-4445-af04-f95ff36d4204', 'e6070ebc-2af8-4204-8646-69b139dd3168'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:46 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132
Sep 25 18:51:46 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:46 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:47 devstack sudo[107840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:47 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-44708f4c-97e0-4832-ad57-1b9bebfa8ba7-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Lock "cinder-44708f4c-97e0-4832-ad57-1b9bebfa8ba7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" acquired by "delete_volume" :: waited 0.040s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:47 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:47 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.325s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dcb1d2-60c6-4ebb-83a1-6b965ec11648]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Deleted volume successfully.
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726c7245-d005-44bf-b98b-cac6116fffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3236cde9-80f3-4ff7-9ff4-9e5311538046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:47 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Volume volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 (592bf5d3-3dd8-411a-bc6e-b612b4bae132): created successfully
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3236cde9-80f3-4ff7-9ff4-9e5311538046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Flow 'volume_create_manager' (e9f39bef-e2dd-4e92-8fff-9a86f20a3c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-24bb4845-a22e-460a-8fdb-d4b745f243bc tempest-ProjectReaderTests-407713932 None] Lock "cinder-8c62be13-e8f3-41e3-ac33-4966f348aefa-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:47 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4c7a654e-40a1-443b-8f37-3ec8b192fdaf tempest-SnapshotDependencyTests-702194495 None] Created volume successfully.
Sep 25 18:51:47 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7
Sep 25 18:51:47 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Creating offline snapshot b40e19a8-3536-45cc-b669-ffd5bb5f462a of volume e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd15429-6109-43f5-a466-f1ebcebcbbe1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:47 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c
Sep 25 18:51:47 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:47 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" returned: 0 in 0.487s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:47 devstack sudo[107851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7
Sep 25 18:51:47 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:47 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c" returned: 0 in 0.395s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:48 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a 1G
Sep 25 18:51:48 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:48 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" returned: 0 in 0.269s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-44708f4c-97e0-4832-ad57-1b9bebfa8ba7" released by "delete_volume" :: held 0.858s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Created reservations ['40c6bdd3-5a3d-4b9e-ae18-545d78267ba8', '21572060-33c5-46ff-a19b-85ed4d4e0143', '667dd77b-bd86-416c-b8c9-da599ff83ad9', 'd8deb288-1d33-430f-b034-77e637c367b5'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:48 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:48 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:48 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a 1G" returned: 0 in 0.605s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41b4eea-a683-4f41-973e-7c69eca7d77c -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:48 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.364s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Deleted volume successfully.
Sep 25 18:51:48 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41b4eea-a683-4f41-973e-7c69eca7d77c -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a
Sep 25 18:51:48 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a60b6a5a-a2f0-44e5-90dc-46d202646aaf tempest-ProjectReaderTests-1152304755 None] Lock "cinder-44708f4c-97e0-4832-ad57-1b9bebfa8ba7-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:49 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41b4eea-a683-4f41-973e-7c69eca7d77c -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a" returned: 0 in 0.468s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:49 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a is being set with open permissions: ugo+rw
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:49 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a
Sep 25 18:51:49 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (11370cda-00b5-4844-9e54-fff6f3fc50d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f41a50f-9411-40e0-854c-fc2c281c75a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f41a50f-9411-40e0-854c-fc2c281c75a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899828065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8234bb-02da-4350-9697-fe906f045835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:49Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7435ca7f-7b6f-4fae-978e-06f517075b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7435ca7f-7b6f-4fae-978e-06f517075b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3612b4f-eb11-4dbc-a08a-c5ab7a4c7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3612b4f-eb11-4dbc-a08a-c5ab7a4c7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8234bb-02da-4350-9697-fe906f045835', 'volume_name': 'volume-bf8234bb-02da-4350-9697-fe906f045835', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14d97c3-95b2-4cb6-866a-80f47c9555b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14d97c3-95b2-4cb6-866a-80f47c9555b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657b91e7-0a7c-4307-b6ca-52b77e9dc2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Volume bf8234bb-02da-4350-9697-fe906f045835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8234bb-02da-4350-9697-fe906f045835', 'volume_size': 1}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:49 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a" returned: 0 in 0.319s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:49 devstack sudo[107876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info
Sep 25 18:51:49 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:49 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:49 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info is being set with open permissions: ugo+rw
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:49 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info
Sep 25 18:51:49 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:49 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.info" returned: 0 in 0.235s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.861s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Creating offline snapshot 7810ac64-eb3a-4cd7-824c-aec27d55e051 of volume 592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:51:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9344c3e7-090f-4da3-8e64-7b449bd5f36f tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777491f-e672-47c0-a04c-e57cb6aeacc0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:50 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132
Sep 25 18:51:50 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:50 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:50 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 1G
Sep 25 18:51:50 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-b40e19a8-3536-45cc-b669-ffd5bb5f462a-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Lock "cinder-b40e19a8-3536-45cc-b669-ffd5bb5f462a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-e41b4eea-a683-4f41-973e-7c69eca7d77c" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-e41b4eea-a683-4f41-973e-7c69eca7d77c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-b40e19a8-3536-45cc-b669-ffd5bb5f462a" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:50 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-b40e19a8-3536-45cc-b669-ffd5bb5f462a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot b40e19a8-3536-45cc-b669-ffd5bb5f462a of volume e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 1G" returned: 0 in 0.452s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df3269-a69a-4fb6-bdbf-d45c28252cae]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:50 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051
Sep 25 18:51:50 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:50 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a
Sep 25 18:51:50 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051" returned: 0 in 0.290s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 is being set with open permissions: ugo+rw
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051
Sep 25 18:51:51 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41b4eea-a683-4f41-973e-7c69eca7d77c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[53452505-211f-4155-8bd5-7fd335793534]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c
Sep 25 18:51:51 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info
Sep 25 18:51:51 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a
Sep 25 18:51:51 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info is being set with open permissions: ugo+rw
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info
Sep 25 18:51:51 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.info" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899828065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8234bb-02da-4350-9697-fe906f045835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:49Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Creating volume bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:51 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:51 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a" returned: 0 in 0.348s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:51 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 1073741824
Sep 25 18:51:51 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:51 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a
Sep 25 18:51:51 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a06507c7-414f-4390-8bfa-d7a8b8c35526 tempest-SnapshotDependencyTests-702194495 None] Create snapshot completed successfully
Sep 25 18:51:52 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c.b40e19a8-3536-45cc-b669-ffd5bb5f462a" returned: 0 in 0.273s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-b40e19a8-3536-45cc-b669-ffd5bb5f462a" released by "_delete_snapshot" :: held 1.498s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-e41b4eea-a683-4f41-973e-7c69eca7d77c" released by "delete_snapshot" :: held 1.522s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Created reservations ['03b60617-6dff-4b2f-a4e1-b2414b3ea5d7', '713c5ac6-57f3-4c0e-b216-27a9a4cbc8d2', '6e20daeb-db51-4a9a-a68d-38b64139c10a', 'f256b518-b659-46c6-8739-e5c0072c56a7'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-521b376e-0378-49e7-aa00-25dd917b21d1 tempest-ProjectMemberTests-502303593 None] Lock "cinder-b40e19a8-3536-45cc-b669-ffd5bb5f462a-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:52 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 1073741824" returned: 0 in 0.542s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:52 devstack sudo[107933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835
Sep 25 18:51:52 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:52 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Flow 'volume_create_manager' (5fb68ff4-561e-4cb8-bd3e-3ce1f89541e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8108c25c-cbba-456d-ba16-e2537ffcaa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8108c25c-cbba-456d-ba16-e2537ffcaa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2b1c06-b9a7-4e77-99dd-822d02ed42ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd572d3da804d9f85b36ba57e332f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7810ac64-eb3a-4cd7-824c-aec27d55e051,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:53Z,use_quota=True,user_id='8c5c81eb9f4d48b6a1f2e0435a3be816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e34311-67cf-4c3c-b3af-93fa269d6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e34311-67cf-4c3c-b3af-93fa269d6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece70b3c-f582-4e29-bb39-123df0dd16d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece70b3c-f582-4e29-bb39-123df0dd16d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a2b1c06-b9a7-4e77-99dd-822d02ed42ad', 'volume_name': 'volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad', 'volume_size': 1, 'snapshot_id': '7810ac64-eb3a-4cd7-824c-aec27d55e051'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f033121e-eb04-40c5-94c5-2f23caaa337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f033121e-eb04-40c5-94c5-2f23caaa337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd97d9f-3844-4988-8869-d6178d771dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Volume 2a2b1c06-b9a7-4e77-99dd-822d02ed42ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad', 'volume_size': 1, 'snapshot_id': '7810ac64-eb3a-4cd7-824c-aec27d55e051'}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657b91e7-0a7c-4307-b6ca-52b77e9dc2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8234bb-02da-4350-9697-fe906f045835', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d326945-4bfb-488c-94e8-a9db62ddc155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-e41b4eea-a683-4f41-973e-7c69eca7d77c-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-quobyte-7810ac64-eb3a-4cd7-824c-aec27d55e051-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" by "_create_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Volume volume-bf8234bb-02da-4350-9697-fe906f045835 (bf8234bb-02da-4350-9697-fe906f045835): created successfully
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d326945-4bfb-488c-94e8-a9db62ddc155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (11370cda-00b5-4844-9e54-fff6f3fc50d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Lock "cinder-e41b4eea-a683-4f41-973e-7c69eca7d77c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-7810ac64-eb3a-4cd7-824c-aec27d55e051-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Creating volume 2a2b1c06-b9a7-4e77-99dd-822d02ed42ad from snapshot 7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-quobyte-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" by "_copy_volume_from_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b3f6ae7e-b2c8-44eb-9b18-7fac98c1f006 tempest-ProjectReaderTests-1152304755 None] Created volume successfully.
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] snapshot: 7810ac64-eb3a-4cd7-824c-aec27d55e051, volume: 2a2b1c06-b9a7-4e77-99dd-822d02ed42ad,  {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-e41b4eea-a683-4f41-973e-7c69eca7d77c" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ea6d7-3baa-406b-9baa-e926b70f662f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-e41b4eea-a683-4f41-973e-7c69eca7d77c" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cbc467-8e39-47fe-a374-da0efd53cfc6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:53 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051
Sep 25 18:51:53 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:53 devstack sudo[107937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c
Sep 25 18:51:53 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:53 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051" returned: 0 in 0.429s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fd90a6-4156-4bd2-b419-bbb68c41c666]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:53 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c" returned: 0 in 0.413s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:53 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c
Sep 25 18:51:53 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:53 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132
Sep 25 18:51:53 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:53 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-e41b4eea-a683-4f41-973e-7c69eca7d77c" returned: 0 in 0.274s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-e41b4eea-a683-4f41-973e-7c69eca7d77c" released by "delete_volume" :: held 0.755s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Created reservations ['30c3464b-ad41-48e0-9cf4-6814478883d8', '9ee73b87-6e02-49b5-8007-0c3568e47583', '0cf260e8-d1d1-44a2-abc5-b7769d1e22e0', '9461c029-75ab-4005-8c83-362f93698080'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:51:53 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132" returned: 0 in 0.403s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Creating direct copy from snapshot {{(pid=86534) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.utils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Path /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad not found in is_blk_device check {{(pid=86534) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:53 devstack sudo[107954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad
Sep 25 18:51:53 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:51:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:51:53 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:51:53 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:51:54 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.276s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:51:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-9f01c66b-2931-4cd7-8b8a-481f6df9d6c6 tempest-ProjectMemberTests-502303593 None] Lock "cinder-e41b4eea-a683-4f41-973e-7c69eca7d77c-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (a37ed43b-751c-4739-841c-c312c9f1fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656b0899-a066-44c3-8bd8-0ad3b7c1ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656b0899-a066-44c3-8bd8-0ad3b7c1ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85551596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c74b05-293d-4249-ba0c-8f51738fca92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:54Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4cdba2-1978-4faa-895c-e6dd2d4d810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4cdba2-1978-4faa-895c-e6dd2d4d810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f66639b-60d2-46ca-86fe-f3f3e90e5a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f66639b-60d2-46ca-86fe-f3f3e90e5a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c74b05-293d-4249-ba0c-8f51738fca92', 'volume_name': 'volume-76c74b05-293d-4249-ba0c-8f51738fca92', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9165c8-5934-40ca-99fd-f5729cae1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9165c8-5934-40ca-99fd-f5729cae1744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48699c8d-3a45-45c0-ba9c-7b250c7fd6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:51:54 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Volume 76c74b05-293d-4249-ba0c-8f51738fca92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c74b05-293d-4249-ba0c-8f51738fca92', 'volume_size': 1}
Sep 25 18:51:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:51:59 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root
Sep 25 18:51:59 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" returned: 0 in 6.146s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:51:59 devstack cinder-volume[86534]: DEBUG cinder.image.image_utils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad {{(pid=86534) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 25 18:52:00 devstack cinder-volume[86534]: INFO cinder.image.image_utils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Converted 1024.00 MB image at 166.57 MB/s
Sep 25 18:52:00 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad is being set with open permissions: ugo+rw
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:00 devstack sudo[107971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad
Sep 25 18:52:00 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:00 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" released by "_copy_volume_from_snapshot" :: held 7.321s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-7810ac64-eb3a-4cd7-824c-aec27d55e051-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" released by "_create_volume_from_snapshot" :: held 7.394s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.422s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.760s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Creating offline snapshot 904d0599-40c0-41e9-aebe-bf7233139adf of volume bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd97d9f-3844-4988-8869-d6178d771dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad', 'volume_size': 1, 'snapshot_id': '7810ac64-eb3a-4cd7-824c-aec27d55e051'}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673bd8f2-098d-4a6e-bd69-484f72f35dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d01f5c-d70d-4a58-833d-20987ae4c239]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:00 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Volume volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad (2a2b1c06-b9a7-4e77-99dd-822d02ed42ad): created successfully
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673bd8f2-098d-4a6e-bd69-484f72f35dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Flow 'volume_create_manager' (5fb68ff4-561e-4cb8-bd3e-3ce1f89541e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:00 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-03e0e375-abe9-464b-a685-702547f9779f tempest-SnapshotDependencyTests-702194495 None] Created volume successfully.
Sep 25 18:52:00 devstack sudo[107974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835
Sep 25 18:52:00 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:00 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:00 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:00 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf 1G
Sep 25 18:52:00 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:01 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf 1G" returned: 0 in 0.378s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8234bb-02da-4350-9697-fe906f045835 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:01 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8234bb-02da-4350-9697-fe906f045835 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf
Sep 25 18:52:01 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:01 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf8234bb-02da-4350-9697-fe906f045835 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf" returned: 0 in 0.284s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:01 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf is being set with open permissions: ugo+rw
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:01 devstack sudo[107991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf
Sep 25 18:52:01 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-7810ac64-eb3a-4cd7-824c-aec27d55e051-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-7810ac64-eb3a-4cd7-824c-aec27d55e051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-quobyte-592bf5d3-3dd8-411a-bc6e-b612b4bae132" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-592bf5d3-3dd8-411a-bc6e-b612b4bae132" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-quobyte-7810ac64-eb3a-4cd7-824c-aec27d55e051" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-7810ac64-eb3a-4cd7-824c-aec27d55e051" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Deleting offline snapshot 7810ac64-eb3a-4cd7-824c-aec27d55e051 of volume 592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] snapshot_file for this snap is: volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c5870-782e-42bb-9319-d883bf420977]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:01 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051
Sep 25 18:52:01 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:01 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:01 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info
Sep 25 18:52:01 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:01 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051" returned: 0 in 0.375s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:01 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c7ada-6b11-4ced-89dd-13ba2ad65e78]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:01 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info is being set with open permissions: ugo+rw
Sep 25 18:52:01 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:01 devstack sudo[108003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info
Sep 25 18:52:01 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:02 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132
Sep 25 18:52:02 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:02 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.info" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.483s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85551596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c74b05-293d-4249-ba0c-8f51738fca92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:51:54Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Creating volume 76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:02 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:02 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 1073741824
Sep 25 18:52:02 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:02 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-297eee27-62e5-4f65-a78c-9f0f016b9cf5 tempest-ProjectReaderTests-1152304755 None] Create snapshot completed successfully
Sep 25 18:52:02 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132" returned: 0 in 0.555s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:02 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051
Sep 25 18:52:02 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:02 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 1073741824" returned: 0 in 0.461s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:02 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92
Sep 25 18:52:02 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:02 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051" returned: 0 in 0.336s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:02 devstack sudo[108024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051
Sep 25 18:52:02 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:02 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92" returned: 0 in 0.267s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48699c8d-3a45-45c0-ba9c-7b250c7fd6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c74b05-293d-4249-ba0c-8f51738fca92', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:02 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b66ee8-5fe4-4435-beb0-430067eb7942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:03 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Volume volume-76c74b05-293d-4249-ba0c-8f51738fca92 (76c74b05-293d-4249-ba0c-8f51738fca92): created successfully
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b66ee8-5fe4-4435-beb0-430067eb7942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (a37ed43b-751c-4739-841c-c312c9f1fc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-904d0599-40c0-41e9-aebe-bf7233139adf-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4eea813b-cb16-4413-a3b2-804efd206cb9 tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Lock "cinder-904d0599-40c0-41e9-aebe-bf7233139adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-bf8234bb-02da-4350-9697-fe906f045835" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:03 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132.7810ac64-eb3a-4cd7-824c-aec27d55e051" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-bf8234bb-02da-4350-9697-fe906f045835" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-904d0599-40c0-41e9-aebe-bf7233139adf" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-7810ac64-eb3a-4cd7-824c-aec27d55e051" released by "_delete_snapshot" :: held 1.664s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-592bf5d3-3dd8-411a-bc6e-b612b4bae132" released by "delete_snapshot" :: held 1.685s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-904d0599-40c0-41e9-aebe-bf7233139adf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Deleting offline snapshot 904d0599-40c0-41e9-aebe-bf7233139adf of volume bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] snapshot_file for this snap is: volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[312fd4ea-3954-495c-939b-b798e4092cae]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Created reservations ['a45a7f37-4205-457c-8746-0c8c6aa75016', '5d78caa4-dfb9-4c15-af5f-a158d0cb203a', '4880498a-05e5-421b-818c-921c40a2a5d6', '9f2b529e-a1db-437c-b056-30ff9f0e62ae'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:03 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf
Sep 25 18:52:03 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:03 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Delete snapshot completed successfully.
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8be13f92-4044-41d2-a8b6-47433ddf553b tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-7810ac64-eb3a-4cd7-824c-aec27d55e051-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:03 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf" returned: 0 in 0.371s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf8234bb-02da-4350-9697-fe906f045835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-592bf5d3-3dd8-411a-bc6e-b612b4bae132-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764fc1d-e62d-4917-aa70-f92e45ff94ec]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-592bf5d3-3dd8-411a-bc6e-b612b4bae132-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-quobyte-592bf5d3-3dd8-411a-bc6e-b612b4bae132" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-592bf5d3-3dd8-411a-bc6e-b612b4bae132" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:03 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835
Sep 25 18:52:03 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f25460-fa37-4f5a-bcf8-41e89d652963]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:03 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132
Sep 25 18:52:03 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:03 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:03 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack sudo[108043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf
Sep 25 18:52:04 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:04 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132" returned: 0 in 0.416s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132
Sep 25 18:52:04 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Creating offline snapshot 975ecf5f-f0ca-4e90-890c-ab4505cd15eb of volume 76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:04 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf" returned: 0 in 0.431s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06e79b-4494-4ec8-989d-2c3d2b387673]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf
Sep 25 18:52:04 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:04 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-592bf5d3-3dd8-411a-bc6e-b612b4bae132" returned: 0 in 0.329s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-592bf5d3-3dd8-411a-bc6e-b612b4bae132" released by "delete_volume" :: held 0.814s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Created reservations ['29faccd0-8619-439f-bd69-c2191ea3d518', 'fda2df80-5dd9-447f-9034-956a19077288', '9c79564a-1593-48ba-868d-91d10fd576a5', 'ab8421cc-5e00-4fcd-ad1a-dad2076fb732'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:04 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92
Sep 25 18:52:04 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:04 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:04 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835.904d0599-40c0-41e9-aebe-bf7233139adf" returned: 0 in 0.302s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-904d0599-40c0-41e9-aebe-bf7233139adf" released by "_delete_snapshot" :: held 1.619s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-bf8234bb-02da-4350-9697-fe906f045835" released by "delete_snapshot" :: held 1.654s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:04 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "cinder-quobyte-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92" returned: 0 in 0.449s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Created reservations ['0631cb23-4732-4465-8c2a-5deded69f430', '330d0bd7-0305-47ca-9302-5bbb009982fd', '22b1683a-7c52-49da-8014-454b856128e1', '48402473-58c6-4542-a6f0-e847ea64bd27'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" acquired by "delete_volume" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:04 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb 1G
Sep 25 18:52:04 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:04 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.317s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:04 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Deleted volume successfully.
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7ea56-3e01-4133-b1c7-96664d06be19]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:04 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-cf753529-6869-436a-9edc-cc440d885767 tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-592bf5d3-3dd8-411a-bc6e-b612b4bae132-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:05 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Delete snapshot completed successfully.
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c5318533-512c-4c39-ae5c-7082bd25d50d tempest-ProjectReaderTests-1152304755 None] Lock "cinder-904d0599-40c0-41e9-aebe-bf7233139adf-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:05 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad
Sep 25 18:52:05 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-bf8234bb-02da-4350-9697-fe906f045835-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Lock "cinder-bf8234bb-02da-4350-9697-fe906f045835-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-bf8234bb-02da-4350-9697-fe906f045835" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-bf8234bb-02da-4350-9697-fe906f045835" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fefb8c-3e62-4f85-87e3-85186a11c8d6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:05 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:05 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" returned: 0 in 0.426s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb 1G" returned: 0 in 0.504s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c74b05-293d-4249-ba0c-8f51738fca92 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:05 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad
Sep 25 18:52:05 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack sudo[108078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c74b05-293d-4249-ba0c-8f51738fca92 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb
Sep 25 18:52:05 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack sudo[108076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835
Sep 25 18:52:05 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-quobyte-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad" released by "delete_volume" :: held 0.768s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:05 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c74b05-293d-4249-ba0c-8f51738fca92 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb" returned: 0 in 0.318s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:05 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb is being set with open permissions: ugo+rw
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:05 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb
Sep 25 18:52:05 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Created reservations ['bb781022-a838-4956-be4b-96f3079666c1', '7b1db9f1-6fc2-4185-b0c7-92c5bb984cc8', '9adfd181-e9fd-49c7-95ec-17551c569d81', 'a0d02776-bf1e-44c2-a989-bb0f531b1bd8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:05 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835" returned: 0 in 0.389s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:05 devstack sudo[108091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835
Sep 25 18:52:05 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:05 devstack sudo[108093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:05 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:05 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:05 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:06 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-bf8234bb-02da-4350-9697-fe906f045835" returned: 0 in 0.287s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:06 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info
Sep 25 18:52:06 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-bf8234bb-02da-4350-9697-fe906f045835" released by "delete_volume" :: held 0.765s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:06 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.286s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Created reservations ['3a32eef1-f657-44a3-ad76-21d8328a6b4a', 'b9ace5eb-3e22-49e8-b3b7-0ef2c011bb12', '3a95c545-c1f3-4c80-915b-b5c37a947eb1', 'f484c0dc-83c0-46b1-9d8d-b0b36134ee4b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Deleted volume successfully.
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-023a3da8-3c3e-4807-a7ef-a656b0c44ccd tempest-SnapshotDependencyTests-702194495 None] Lock "cinder-2a2b1c06-b9a7-4e77-99dd-822d02ed42ad-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:06 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:06 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:06 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:06 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info is being set with open permissions: ugo+rw
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:06 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info
Sep 25 18:52:06 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:06 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.288s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Deleted volume successfully.
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-5ef371b0-5af4-4a8b-a489-2a9e00eba5bb tempest-ProjectReaderTests-1152304755 None] Lock "cinder-bf8234bb-02da-4350-9697-fe906f045835-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:06 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.info" returned: 0 in 0.275s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:06 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d1415664-46ed-4cf1-95a2-313c05428a96 tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (a508992d-5283-4e6c-87eb-f598e2fb6eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4423704-1945-433c-9f0c-cc6575246bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4423704-1945-433c-9f0c-cc6575246bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934156847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f06f89f-1cfd-47cd-b67d-c4581a5eda10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:07Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311f9f36-d9b5-4a78-b649-1ff24062bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311f9f36-d9b5-4a78-b649-1ff24062bb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901c806b-5ca4-48fa-92e1-dfc773225400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901c806b-5ca4-48fa-92e1-dfc773225400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f06f89f-1cfd-47cd-b67d-c4581a5eda10', 'volume_name': 'volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c7a015-7fd1-4d30-830b-2f414f3f4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c7a015-7fd1-4d30-830b-2f414f3f4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9126cb6-4f1e-4290-9549-8ab27bda7eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:06 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Volume 3f06f89f-1cfd-47cd-b67d-c4581a5eda10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10', 'volume_size': 1}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-934156847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f06f89f-1cfd-47cd-b67d-c4581a5eda10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:07Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Creating volume 3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:06 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:07 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:07 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 1073741824
Sep 25 18:52:07 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:07 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 1073741824" returned: 0 in 0.440s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:07 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10
Sep 25 18:52:07 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-975ecf5f-f0ca-4e90-890c-ab4505cd15eb-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Lock "cinder-975ecf5f-f0ca-4e90-890c-ab4505cd15eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-76c74b05-293d-4249-ba0c-8f51738fca92" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-76c74b05-293d-4249-ba0c-8f51738fca92" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-975ecf5f-f0ca-4e90-890c-ab4505cd15eb" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-975ecf5f-f0ca-4e90-890c-ab4505cd15eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot 975ecf5f-f0ca-4e90-890c-ab4505cd15eb of volume 76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[274b532b-18eb-419f-959a-3b23c1644e8e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:07 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" returned: 0 in 0.374s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:07 devstack sudo[108116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb
Sep 25 18:52:07 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9126cb6-4f1e-4290-9549-8ab27bda7eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca10aa8-3b9b-4073-9735-5c79303839e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:07 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Volume volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 (3f06f89f-1cfd-47cd-b67d-c4581a5eda10): created successfully
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca10aa8-3b9b-4073-9735-5c79303839e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:07 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (a508992d-5283-4e6c-87eb-f598e2fb6eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:07 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5e56ea24-db48-4c5d-8c78-97198befedb5 tempest-ProjectReaderTests-1152304755 None] Created volume successfully.
Sep 25 18:52:08 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb" returned: 0 in 0.385s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c74b05-293d-4249-ba0c-8f51738fca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[597404f0-31f5-411a-9c68-0e28d6a523fb]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:08 devstack sudo[108122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92
Sep 25 18:52:08 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:08 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:08 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb
Sep 25 18:52:08 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:08 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb" returned: 0 in 0.425s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:08 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:09 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb
Sep 25 18:52:09 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Creating offline snapshot f6597405-044e-47e2-838b-b13935f4e240 of volume 3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c369622-e4da-4b00-b4fa-89654b370d8e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:09 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92.975ecf5f-f0ca-4e90-890c-ab4505cd15eb" returned: 0 in 0.289s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-975ecf5f-f0ca-4e90-890c-ab4505cd15eb" released by "_delete_snapshot" :: held 1.602s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:09 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10
Sep 25 18:52:09 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-76c74b05-293d-4249-ba0c-8f51738fca92" released by "delete_snapshot" :: held 1.630s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Created reservations ['ba914d56-7a1b-44c8-a36c-76d7fca9327d', 'b144b405-526e-43d1-8b96-c1955a9cc03f', 'a60d473f-c725-4935-9493-78eb96bcef1b', '9940c683-aa13-407f-a03d-8f8d41473c57'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:09 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-a3f0a08b-202b-443a-950f-3707ee194878 tempest-ProjectMemberTests-502303593 None] Lock "cinder-975ecf5f-f0ca-4e90-890c-ab4505cd15eb-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:09 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" returned: 0 in 0.412s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:09 devstack sudo[108141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 1G
Sep 25 18:52:09 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-76c74b05-293d-4249-ba0c-8f51738fca92-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Lock "cinder-76c74b05-293d-4249-ba0c-8f51738fca92-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-76c74b05-293d-4249-ba0c-8f51738fca92" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-76c74b05-293d-4249-ba0c-8f51738fca92" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07e1ac-1695-44af-b098-0fa297abee95]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:09 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:10 devstack sudo[108147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92
Sep 25 18:52:10 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:10 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 1G" returned: 0 in 0.544s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:10 devstack sudo[108150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240
Sep 25 18:52:10 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:10 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92" returned: 0 in 0.430s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:10 devstack sudo[108159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92
Sep 25 18:52:10 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:10 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:10 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 is being set with open permissions: ugo+rw
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:10 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240
Sep 25 18:52:10 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:10 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-76c74b05-293d-4249-ba0c-8f51738fca92" returned: 0 in 0.315s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-76c74b05-293d-4249-ba0c-8f51738fca92" released by "delete_volume" :: held 0.822s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:10 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Created reservations ['4a5c4ed1-7927-4886-8fcc-9314e350a6be', '87402e60-95d5-47e9-b691-7901e5673280', '1091a973-bca2-4caf-8293-89c3d0bd49fe', '152bce61-adc6-4c4f-b476-d3c090ea3c60'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240" returned: 0 in 0.313s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:10 devstack sudo[108167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info
Sep 25 18:52:10 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:10 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:10 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:10 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:11 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info" returned: 0 in 0.305s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:11 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info is being set with open permissions: ugo+rw
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:11 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.274s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:11 devstack sudo[108173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info
Sep 25 18:52:11 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fbb92986-451d-4a15-9f52-7e43bdbdf887 tempest-ProjectMemberTests-502303593 None] Lock "cinder-76c74b05-293d-4249-ba0c-8f51738fca92-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:11 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.info" returned: 0 in 0.309s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:11 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-93081b0d-0d10-43b4-898b-064b1fd62428 tempest-ProjectReaderTests-1152304755 None] Create snapshot completed successfully
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (a4957ffd-aec0-454b-b428-c097dfaeb60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d4761-9edc-45ad-8f26-8c23619625ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42d4761-9edc-45ad-8f26-8c23619625ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208122385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b676f75c-3845-4c2a-adb1-07428168d3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:11Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0ed542-5961-4ffa-ba50-ce394373547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0ed542-5961-4ffa-ba50-ce394373547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b136c-6099-416e-8958-f9f05bb92ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1b136c-6099-416e-8958-f9f05bb92ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b676f75c-3845-4c2a-adb1-07428168d3ff', 'volume_name': 'volume-b676f75c-3845-4c2a-adb1-07428168d3ff', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15baefc1-57de-4559-8337-2983821cb27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15baefc1-57de-4559-8337-2983821cb27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf9a4ec-5e2e-4dcf-bf91-d8d3570c670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:11 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Volume b676f75c-3845-4c2a-adb1-07428168d3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b676f75c-3845-4c2a-adb1-07428168d3ff', 'volume_size': 1}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208122385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b676f75c-3845-4c2a-adb1-07428168d3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:11Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Creating volume b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:11 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:11 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:11 devstack sudo[108176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff 1073741824
Sep 25 18:52:11 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:12 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff 1073741824" returned: 0 in 0.458s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:12 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff
Sep 25 18:52:12 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-f6597405-044e-47e2-838b-b13935f4e240-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Lock "cinder-f6597405-044e-47e2-838b-b13935f4e240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-f6597405-044e-47e2-838b-b13935f4e240" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-f6597405-044e-47e2-838b-b13935f4e240" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Deleting offline snapshot f6597405-044e-47e2-838b-b13935f4e240 of volume 3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] snapshot_file for this snap is: volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f0276d-dd96-4694-94cb-4b39dd8338d5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:12 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff" returned: 0 in 0.331s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf9a4ec-5e2e-4dcf-bf91-d8d3570c670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b676f75c-3845-4c2a-adb1-07428168d3ff', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38e81cf-6581-49e8-bfd5-f8e457ea16f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:12 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Volume volume-b676f75c-3845-4c2a-adb1-07428168d3ff (b676f75c-3845-4c2a-adb1-07428168d3ff): created successfully
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c38e81cf-6581-49e8-bfd5-f8e457ea16f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (a4957ffd-aec0-454b-b428-c097dfaeb60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:12 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fdc86db8-bddd-4ce4-838a-e8af4a1985a0 tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:52:12 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240
Sep 25 18:52:12 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:12 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06eaeb6-79f7-4b75-b5cf-2f626a1966b6]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:12 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:13 devstack sudo[108191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10
Sep 25 18:52:13 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:13 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" returned: 0 in 0.406s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:13 devstack sudo[108197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240
Sep 25 18:52:13 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:13 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240" returned: 0 in 0.372s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:13 devstack sudo[108203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240
Sep 25 18:52:13 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Creating offline snapshot 75a81c5b-ea2e-4ca5-acad-a1bba6c7269a of volume b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6b89b-8d82-41fa-9047-732a004682a5]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:13 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:13 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff
Sep 25 18:52:13 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:14 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10.f6597405-044e-47e2-838b-b13935f4e240" returned: 0 in 0.269s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-f6597405-044e-47e2-838b-b13935f4e240" released by "_delete_snapshot" :: held 1.568s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" released by "delete_snapshot" :: held 1.601s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Created reservations ['2ae0e855-30ec-4f12-af8b-a3069131566c', '76e2563e-0a02-410a-9ee8-edcd5744b418', 'e95d091d-c91a-49f5-9b13-d35cd4b0553c', '1e5403ce-5660-48b8-8834-489786fa97c2'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:14 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Delete snapshot completed successfully.
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-3ff107a9-464a-4125-97a7-70b341d697dd tempest-ProjectReaderTests-1152304755 None] Lock "cinder-f6597405-044e-47e2-838b-b13935f4e240-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:14 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff" returned: 0 in 0.429s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:14 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a 1G
Sep 25 18:52:14 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-3f06f89f-1cfd-47cd-b67d-c4581a5eda10-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-3f06f89f-1cfd-47cd-b67d-c4581a5eda10-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" acquired by "delete_volume" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7085fc2-04b6-47ff-823d-e341531e3a31]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:14 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a 1G" returned: 0 in 0.576s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:14 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b676f75c-3845-4c2a-adb1-07428168d3ff -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:14 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b676f75c-3845-4c2a-adb1-07428168d3ff -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a
Sep 25 18:52:14 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:14 devstack sudo[108218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10
Sep 25 18:52:14 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:15 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b676f75c-3845-4c2a-adb1-07428168d3ff -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" returned: 0 in 0.318s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:15 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a is being set with open permissions: ugo+rw
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:15 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" returned: 0 in 0.459s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:15 devstack sudo[108230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a
Sep 25 18:52:15 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:15 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10
Sep 25 18:52:15 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:15 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" returned: 0 in 0.291s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:15 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" returned: 0 in 0.297s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:15 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info
Sep 25 18:52:15 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-3f06f89f-1cfd-47cd-b67d-c4581a5eda10" released by "delete_volume" :: held 0.842s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Created reservations ['523d1cd5-e29c-4c57-aaf9-68199d627e75', '8299238d-cdcd-41e6-9fc1-3aa1bc542a66', 'c355f33d-01cf-41c7-b3c5-067d54dacb64', '45a0ffe7-84a9-424d-a56e-f80fef485788'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:15 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:15 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:15 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info" returned: 0 in 0.340s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:15 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info is being set with open permissions: ugo+rw
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:15 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info
Sep 25 18:52:15 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:15 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:15 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.307s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Deleted volume successfully.
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-16478c36-e642-4c4a-98fa-2bb3bb700758 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-3f06f89f-1cfd-47cd-b67d-c4581a5eda10-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:16 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.info" returned: 0 in 0.358s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:16 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-9a992bb4-5ff4-495b-85b8-2de232f7bab0 tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (a19598ab-8f8c-4404-a470-5e64bb136991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576e6b42-e2e8-4176-b5c9-bdd6b2202de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576e6b42-e2e8-4176-b5c9-bdd6b2202de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122983605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef9a924-a184-4479-94be-452be42a7751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:16Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab879c0a-d7bd-426b-aeb6-e825bef518de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab879c0a-d7bd-426b-aeb6-e825bef518de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8317c5b8-c4e9-47f2-b1bf-73a7c18e10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8317c5b8-c4e9-47f2-b1bf-73a7c18e10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef9a924-a184-4479-94be-452be42a7751', 'volume_name': 'volume-9ef9a924-a184-4479-94be-452be42a7751', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb0304c-2cd4-4815-8d9c-d9ed85c938be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb0304c-2cd4-4815-8d9c-d9ed85c938be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac27eb3-914a-493b-808f-fa5599e6dc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:16 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Volume 9ef9a924-a184-4479-94be-452be42a7751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef9a924-a184-4479-94be-452be42a7751', 'volume_size': 1}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122983605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef9a924-a184-4479-94be-452be42a7751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d90485a7f94b17b7b4c328a0efa788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:16Z,use_quota=True,user_id='b69c6685ac4c4485923005f9ed52545f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Creating volume 9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:16 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:16 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 1073741824
Sep 25 18:52:16 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:16 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 1073741824" returned: 0 in 0.471s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:16 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:16 devstack sudo[108251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751
Sep 25 18:52:16 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-75a81c5b-ea2e-4ca5-acad-a1bba6c7269a-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Lock "cinder-75a81c5b-ea2e-4ca5-acad-a1bba6c7269a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-b676f75c-3845-4c2a-adb1-07428168d3ff" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-b676f75c-3845-4c2a-adb1-07428168d3ff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot 75a81c5b-ea2e-4ca5-acad-a1bba6c7269a of volume b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff70cea-19da-4159-a0e4-549be54afe98]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:17 devstack sudo[108253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a
Sep 25 18:52:17 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:17 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751" returned: 0 in 0.320s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac27eb3-914a-493b-808f-fa5599e6dc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef9a924-a184-4479-94be-452be42a7751', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a765e8d4-368d-4934-8f7f-4bb7fca7a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:17 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Volume volume-9ef9a924-a184-4479-94be-452be42a7751 (9ef9a924-a184-4479-94be-452be42a7751): created successfully
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a765e8d4-368d-4934-8f7f-4bb7fca7a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Flow 'volume_create_manager' (a19598ab-8f8c-4404-a470-5e64bb136991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:17 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d8ecc6df-2883-4ecc-9130-84b0907143bd tempest-ProjectReaderTests-1152304755 None] Created volume successfully.
Sep 25 18:52:17 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" returned: 0 in 0.410s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b676f75c-3845-4c2a-adb1-07428168d3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a229e1-5de0-46e1-a3c1-2ed5751c6df4]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:17 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff
Sep 25 18:52:17 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:17 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff" returned: 0 in 0.355s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:17 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:17 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a
Sep 25 18:52:17 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:18 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" returned: 0 in 0.331s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:18 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a
Sep 25 18:52:18 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:18 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff.75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-75a81c5b-ea2e-4ca5-acad-a1bba6c7269a" released by "_delete_snapshot" :: held 1.484s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-b676f75c-3845-4c2a-adb1-07428168d3ff" released by "delete_snapshot" :: held 1.510s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Creating offline snapshot f9fffc63-3e82-4158-979f-324790febf1b of volume 9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3eaee9-9048-46dc-9a80-81a0ac9fdc54]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Created reservations ['c307e5bf-c0b6-463a-a628-1f014cf05f45', '26784668-fcc2-4055-8472-ec25364b78ed', '577e41c5-afdf-4d61-9db3-77925aeb79bb', 'a9299c58-097c-489d-982d-9b05d58fc95d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:18 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-4d0c7952-c55b-4397-91d9-f1d851e2d04e tempest-ProjectMemberTests-502303593 None] Lock "cinder-75a81c5b-ea2e-4ca5-acad-a1bba6c7269a-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:18 devstack sudo[108272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751
Sep 25 18:52:18 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:18 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751" returned: 0 in 0.359s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:18 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:19 devstack sudo[108277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b 1G
Sep 25 18:52:19 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-b676f75c-3845-4c2a-adb1-07428168d3ff-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Lock "cinder-b676f75c-3845-4c2a-adb1-07428168d3ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-b676f75c-3845-4c2a-adb1-07428168d3ff" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-b676f75c-3845-4c2a-adb1-07428168d3ff" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76fdf8-6b59-4191-a8d8-47d63157c81f]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:19 devstack sudo[108282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff
Sep 25 18:52:19 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:19 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b 1G" returned: 0 in 0.446s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef9a924-a184-4479-94be-452be42a7751 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:19 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef9a924-a184-4479-94be-452be42a7751 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b
Sep 25 18:52:19 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:19 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff" returned: 0 in 0.411s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:19 devstack sudo[108293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff
Sep 25 18:52:19 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:19 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef9a924-a184-4479-94be-452be42a7751 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b" returned: 0 in 0.312s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:19 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b is being set with open permissions: ugo+rw
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:19 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b
Sep 25 18:52:19 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:19 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-b676f75c-3845-4c2a-adb1-07428168d3ff" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:19 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-b676f75c-3845-4c2a-adb1-07428168d3ff" released by "delete_volume" :: held 0.737s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:20 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b" returned: 0 in 0.263s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Created reservations ['730812fe-f453-486b-ac87-4294e3c81627', '0f0f473a-0f57-45e4-8917-85108cde398f', 'e801ee5b-1275-4d2e-9081-9edfac373dfb', '3720fe4b-59d1-4dd3-84bd-360dd71c2d92'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:20 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info
Sep 25 18:52:20 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:20 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:20 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:20 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info" returned: 0 in 0.277s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:20 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info is being set with open permissions: ugo+rw
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:20 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info
Sep 25 18:52:20 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:20 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fdff542a-fc8b-4d65-8919-35eb526a673d tempest-ProjectMemberTests-502303593 None] Lock "cinder-b676f75c-3845-4c2a-adb1-07428168d3ff-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:20 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.info" returned: 0 in 0.276s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:20 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f90dc921-6ca2-492d-815a-b3acde2c7bc3 tempest-ProjectReaderTests-1152304755 None] Create snapshot completed successfully
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (436986e3-6927-40a5-ad5f-3ce2ba11e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ca1183-8efe-4454-9c4e-9727f5ef22b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ca1183-8efe-4454-9c4e-9727f5ef22b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734221241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880d674a-356e-4f95-aeb0-ac6515d07eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:21Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bcd9c-69c1-4813-8151-aa017c88c71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79bcd9c-69c1-4813-8151-aa017c88c71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40051c7f-630a-41d8-a534-533b7c28ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40051c7f-630a-41d8-a534-533b7c28ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880d674a-356e-4f95-aeb0-ac6515d07eca', 'volume_name': 'volume-880d674a-356e-4f95-aeb0-ac6515d07eca', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7a25f6-a80e-46fd-9f5a-5db670bbff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7a25f6-a80e-46fd-9f5a-5db670bbff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df41937-5f34-45a8-a0cd-9395cb2ae0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:20 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Volume 880d674a-356e-4f95-aeb0-ac6515d07eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880d674a-356e-4f95-aeb0-ac6515d07eca', 'volume_size': 1}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734221241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880d674a-356e-4f95-aeb0-ac6515d07eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:21Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Creating volume 880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:20 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:20 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:20 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca 1073741824
Sep 25 18:52:20 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:21 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca 1073741824" returned: 0 in 0.430s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:21 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca
Sep 25 18:52:21 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:21 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca" returned: 0 in 0.264s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df41937-5f34-45a8-a0cd-9395cb2ae0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880d674a-356e-4f95-aeb0-ac6515d07eca', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba4b9f0-ec8d-4e0f-86a9-949e2f40940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:21 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Volume volume-880d674a-356e-4f95-aeb0-ac6515d07eca (880d674a-356e-4f95-aeb0-ac6515d07eca): created successfully
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba4b9f0-ec8d-4e0f-86a9-949e2f40940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (436986e3-6927-40a5-ad5f-3ce2ba11e974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:21 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-5a846dc9-499a-4e55-b7c3-8e572ff883cf tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-f9fffc63-3e82-4158-979f-324790febf1b-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-f9fffc63-3e82-4158-979f-324790febf1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-9ef9a924-a184-4479-94be-452be42a7751" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-9ef9a924-a184-4479-94be-452be42a7751" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-f9fffc63-3e82-4158-979f-324790febf1b" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-f9fffc63-3e82-4158-979f-324790febf1b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Deleting offline snapshot f9fffc63-3e82-4158-979f-324790febf1b of volume 9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] snapshot_file for this snap is: volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522e552-0afb-45da-bcdf-ac2472248d59]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:21 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:21 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b
Sep 25 18:52:21 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Creating offline snapshot ed439b56-b8f6-441e-8380-5e9b116eb157 of volume 880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575bea4-2c0c-4592-9284-476ba2d9e5f7]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:22 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca
Sep 25 18:52:22 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:22 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b" returned: 0 in 0.373s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ef9a924-a184-4479-94be-452be42a7751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1becfec-a8ec-41cb-ab2b-358bb9685861]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:22 devstack sudo[108326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751
Sep 25 18:52:22 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:22 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca" returned: 0 in 0.382s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:22 devstack sudo[108331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 1G
Sep 25 18:52:22 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:22 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751" returned: 0 in 0.370s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:22 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b
Sep 25 18:52:22 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:22 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 1G" returned: 0 in 0.418s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:22 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-880d674a-356e-4f95-aeb0-ac6515d07eca -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:22 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-880d674a-356e-4f95-aeb0-ac6515d07eca -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157
Sep 25 18:52:22 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:23 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b" returned: 0 in 0.373s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:23 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b
Sep 25 18:52:23 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:23 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-880d674a-356e-4f95-aeb0-ac6515d07eca -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157" returned: 0 in 0.306s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:23 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 is being set with open permissions: ugo+rw
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:23 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157
Sep 25 18:52:23 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:23 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751.f9fffc63-3e82-4158-979f-324790febf1b" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-f9fffc63-3e82-4158-979f-324790febf1b" released by "_delete_snapshot" :: held 1.491s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-9ef9a924-a184-4479-94be-452be42a7751" released by "delete_snapshot" :: held 1.513s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Created reservations ['6c09f2c1-2c1a-47bd-b536-637d7659b1c5', '1f9528c4-bb3a-4489-9975-713f804a2c2c', '9c479cae-ec55-43c3-92e3-aa2bb62481e7', '4bbc6176-a6dd-4621-afa4-5d90e39d46d3'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:23 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Delete snapshot completed successfully.
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-98644d4f-3b45-4dc6-9671-14ac78624c60 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-f9fffc63-3e82-4158-979f-324790febf1b-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:23 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:23 devstack sudo[108355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info
Sep 25 18:52:23 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:23 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:23 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info is being set with open permissions: ugo+rw
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:23 devstack sudo[108358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info
Sep 25 18:52:23 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-9ef9a924-a184-4479-94be-452be42a7751-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-9ef9a924-a184-4479-94be-452be42a7751-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:23 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:23 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.info" returned: 0 in 0.259s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "cinder-quobyte-9ef9a924-a184-4479-94be-452be42a7751" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-9ef9a924-a184-4479-94be-452be42a7751" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:24 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-95e285aa-9427-4d2a-93fd-13401afd17e6 tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe765a5-2ae5-4c87-9076-cc36e27f8e2a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:24 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751
Sep 25 18:52:24 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:24 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751" returned: 0 in 0.360s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:24 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751
Sep 25 18:52:24 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:24 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-9ef9a924-a184-4479-94be-452be42a7751" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-quobyte-9ef9a924-a184-4479-94be-452be42a7751" released by "delete_volume" :: held 0.677s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Created reservations ['e2651223-8f02-45c3-9d59-9a9010c68728', 'e42f9957-2a48-458e-be30-551b3ccb08e1', 'd4ebed4a-8bff-466b-9d57-14822e64d01e', 'b3571c31-bfd3-46dd-842d-6f344bfa87ca'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:24 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:24 devstack sudo[108369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:24 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:25 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.240s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:25 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Deleted volume successfully.
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-8e0a873d-4b93-45e2-be1b-343e55885242 tempest-ProjectReaderTests-1152304755 None] Lock "cinder-9ef9a924-a184-4479-94be-452be42a7751-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-ed439b56-b8f6-441e-8380-5e9b116eb157-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Lock "cinder-ed439b56-b8f6-441e-8380-5e9b116eb157-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-880d674a-356e-4f95-aeb0-ac6515d07eca" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-880d674a-356e-4f95-aeb0-ac6515d07eca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-ed439b56-b8f6-441e-8380-5e9b116eb157" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-ed439b56-b8f6-441e-8380-5e9b116eb157" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot ed439b56-b8f6-441e-8380-5e9b116eb157 of volume 880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c241849f-86bc-4c9a-be22-c02568e32567]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:25 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157
Sep 25 18:52:25 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:25 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157" returned: 0 in 0.374s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-880d674a-356e-4f95-aeb0-ac6515d07eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0e06a-1876-4f09-8516-f18563e6c4a9]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:25 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:25 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca
Sep 25 18:52:25 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:26 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca" returned: 0 in 0.433s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:26 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157
Sep 25 18:52:26 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:26 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157" returned: 0 in 0.398s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:26 devstack sudo[108388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157
Sep 25 18:52:26 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:26 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca.ed439b56-b8f6-441e-8380-5e9b116eb157" returned: 0 in 0.297s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-ed439b56-b8f6-441e-8380-5e9b116eb157" released by "_delete_snapshot" :: held 1.614s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-880d674a-356e-4f95-aeb0-ac6515d07eca" released by "delete_snapshot" :: held 1.641s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:26 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Created reservations ['b64f29f9-3478-40e3-b969-08908b54f512', 'ef07b0cd-9f37-4887-bd5c-eef8060c21ed', '38582fad-029d-49d2-8d31-fac7958b3e38', 'ff87561a-34f9-4bf7-8784-7cb08318ffb8'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:26 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e6b5af83-3a0b-4ad3-86a7-b7392d370cec tempest-ProjectMemberTests-502303593 None] Lock "cinder-ed439b56-b8f6-441e-8380-5e9b116eb157-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-880d674a-356e-4f95-aeb0-ac6515d07eca-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Lock "cinder-880d674a-356e-4f95-aeb0-ac6515d07eca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-880d674a-356e-4f95-aeb0-ac6515d07eca" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-880d674a-356e-4f95-aeb0-ac6515d07eca" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4665f0-be65-4568-8f64-57bd291868ed]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:27 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca
Sep 25 18:52:27 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:27 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca" returned: 0 in 0.392s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:27 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:27 devstack sudo[108396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca
Sep 25 18:52:27 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:28 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-880d674a-356e-4f95-aeb0-ac6515d07eca" returned: 0 in 0.257s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-880d674a-356e-4f95-aeb0-ac6515d07eca" released by "delete_volume" :: held 0.723s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Created reservations ['fd2412a0-088b-4731-be3f-f8171baa6b0c', '6eba380c-82c6-4167-9ebb-655ae211b06a', '5116119c-5cb4-48eb-af2e-92b884436299', 'f674b2e1-12aa-41e6-80b0-fe31da9ac522'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:28 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:28 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:28 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:28 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=259,cinder:SELECT=187,cinder:INSERT=70,cinder:DELETE=23 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:52:28 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-d53d5cea-fb03-4b9e-9954-46dea4dbcc0f tempest-ProjectMemberTests-502303593 None] Lock "cinder-880d674a-356e-4f95-aeb0-ac6515d07eca-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=199,cinder:UPDATE=245,cinder:INSERT=67,cinder:DELETE=18 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (37a5f9a3-19db-4016-a7bb-d1346bb4ce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78ff5fa-4dbb-4f37-9850-c151b96e6aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78ff5fa-4dbb-4f37-9850-c151b96e6aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318860260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac05584-403b-4bf1-b0b0-5d4568308c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:29Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdf18d3-a4ec-4e15-8b0c-4719a1cdd242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdf18d3-a4ec-4e15-8b0c-4719a1cdd242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2556e7-ed73-49f6-8178-a49af5d36997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2556e7-ed73-49f6-8178-a49af5d36997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac05584-403b-4bf1-b0b0-5d4568308c78', 'volume_name': 'volume-dac05584-403b-4bf1-b0b0-5d4568308c78', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8488e4ff-198d-4a29-923b-b60a86995a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8488e4ff-198d-4a29-923b-b60a86995a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb4d1b8-431d-47ef-8703-d4eac98c23ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:29 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Volume dac05584-403b-4bf1-b0b0-5d4568308c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac05584-403b-4bf1-b0b0-5d4568308c78', 'volume_size': 1}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318860260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac05584-403b-4bf1-b0b0-5d4568308c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:29Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Creating volume dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:29 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:29 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 1073741824
Sep 25 18:52:29 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:29 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 1073741824" returned: 0 in 0.414s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:29 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:29 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78
Sep 25 18:52:29 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:30 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78" returned: 0 in 0.248s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb4d1b8-431d-47ef-8703-d4eac98c23ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac05584-403b-4bf1-b0b0-5d4568308c78', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ab1d38-f91d-477a-8e0b-98bdcd213066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:30 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Volume volume-dac05584-403b-4bf1-b0b0-5d4568308c78 (dac05584-403b-4bf1-b0b0-5d4568308c78): created successfully
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ab1d38-f91d-477a-8e0b-98bdcd213066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:30 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (37a5f9a3-19db-4016-a7bb-d1346bb4ce87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:30 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-63347ad6-05e4-4cca-a8ba-d6c094e8d1a8 tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Creating offline snapshot e91ada30-a2dd-4e27-8a24-9c5863bba1dc of volume dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[727724d0-ad95-4bb7-8193-422cff80f6b0]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:31 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78
Sep 25 18:52:31 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:31 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78" returned: 0 in 0.363s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:31 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:31 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc 1G
Sep 25 18:52:31 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:32 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc 1G" returned: 0 in 0.439s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac05584-403b-4bf1-b0b0-5d4568308c78 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:32 devstack sudo[108424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac05584-403b-4bf1-b0b0-5d4568308c78 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc
Sep 25 18:52:32 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:32 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac05584-403b-4bf1-b0b0-5d4568308c78 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc" returned: 0 in 0.317s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc is being set with open permissions: ugo+rw
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:32 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc
Sep 25 18:52:32 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:32 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:32 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info
Sep 25 18:52:32 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:32 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info" returned: 0 in 0.247s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:32 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info is being set with open permissions: ugo+rw
Sep 25 18:52:32 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:32 devstack sudo[108435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info
Sep 25 18:52:32 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:33 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.info" returned: 0 in 0.245s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:33 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-0e2d42c9-8645-41b2-8dfc-500d7b50fec0 tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-e91ada30-a2dd-4e27-8a24-9c5863bba1dc-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Lock "cinder-e91ada30-a2dd-4e27-8a24-9c5863bba1dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-dac05584-403b-4bf1-b0b0-5d4568308c78" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-dac05584-403b-4bf1-b0b0-5d4568308c78" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-e91ada30-a2dd-4e27-8a24-9c5863bba1dc" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-e91ada30-a2dd-4e27-8a24-9c5863bba1dc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot e91ada30-a2dd-4e27-8a24-9c5863bba1dc of volume dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b3c852-e2c1-4043-a83a-68952477669d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:33 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc
Sep 25 18:52:33 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:33 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc" returned: 0 in 0.383s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dac05584-403b-4bf1-b0b0-5d4568308c78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced8fec6-668c-4d0d-a045-53a45480ccb1]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:33 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:33 devstack sudo[108444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78
Sep 25 18:52:33 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:34 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78" returned: 0 in 0.388s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:34 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc
Sep 25 18:52:34 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:34 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc" returned: 0 in 0.353s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:34 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc
Sep 25 18:52:34 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:34 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78.e91ada30-a2dd-4e27-8a24-9c5863bba1dc" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-e91ada30-a2dd-4e27-8a24-9c5863bba1dc" released by "_delete_snapshot" :: held 1.502s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:34 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-dac05584-403b-4bf1-b0b0-5d4568308c78" released by "delete_snapshot" :: held 1.526s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Created reservations ['6364d573-0035-4510-8845-72f04823085b', '80562f67-e4a8-447b-a6be-e5bd9b6f23eb', 'e59f8594-6d43-4817-9485-892a03f5383f', '8023a0a0-4ec2-4bf3-933b-cd2a2742af39'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:35 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-c3d1bc2f-a543-4f20-ab34-9798186b3163 tempest-ProjectMemberTests-502303593 None] Lock "cinder-e91ada30-a2dd-4e27-8a24-9c5863bba1dc-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-dac05584-403b-4bf1-b0b0-5d4568308c78-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Lock "cinder-dac05584-403b-4bf1-b0b0-5d4568308c78-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-dac05584-403b-4bf1-b0b0-5d4568308c78" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-dac05584-403b-4bf1-b0b0-5d4568308c78" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a2be5-651f-46e6-9907-d6e2d97e0e0c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:35 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:35 devstack sudo[108492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78
Sep 25 18:52:35 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:36 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78" returned: 0 in 0.397s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:36 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78
Sep 25 18:52:36 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:36 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-dac05584-403b-4bf1-b0b0-5d4568308c78" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-dac05584-403b-4bf1-b0b0-5d4568308c78" released by "delete_volume" :: held 0.714s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Created reservations ['cf18604a-f901-4db4-b54d-befc10b7d48b', '16ce6fea-ada4-412d-9fe4-bfd71266942b', 'e8da4bf8-6039-40cb-b597-74da8e0ced00', 'b305b5c5-1ba4-4f44-a933-f1b79874a25c'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:36 devstack sudo[108502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:36 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:36 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.273s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:36 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:52:36 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e7c48ad1-8591-4021-89be-f3c4f150c846 tempest-ProjectMemberTests-502303593 None] Lock "cinder-dac05584-403b-4bf1-b0b0-5d4568308c78-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (73a4d49c-0d91-4b8c-8b7e-574d7b7fdd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320929a2-53ea-49b1-b41b-2dd7803d1795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320929a2-53ea-49b1-b41b-2dd7803d1795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498486566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569b4309-470d-4faf-8fb4-e53416f4a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:37Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7d0abc-7f3d-496e-b19e-7c15b7b91349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb7d0abc-7f3d-496e-b19e-7c15b7b91349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4889a865-9b05-4c93-a019-e9ec0a0aba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4889a865-9b05-4c93-a019-e9ec0a0aba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569b4309-470d-4faf-8fb4-e53416f4a327', 'volume_name': 'volume-569b4309-470d-4faf-8fb4-e53416f4a327', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e7824b-9b33-4d6e-89cb-ae00b5e9d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e7824b-9b33-4d6e-89cb-ae00b5e9d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e973f821-f8f7-4006-8437-851e3448d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:37 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Volume 569b4309-470d-4faf-8fb4-e53416f4a327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569b4309-470d-4faf-8fb4-e53416f4a327', 'volume_size': 1}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498486566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569b4309-470d-4faf-8fb4-e53416f4a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27aed6b6d4f5433481e76a77dcefa0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:37Z,use_quota=True,user_id='8523bede817f4b36a8f5334e4ea07e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Creating volume 569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:37 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:37 devstack sudo[108505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 1073741824
Sep 25 18:52:37 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:37 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 1073741824" returned: 0 in 0.465s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:37 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:37 devstack sudo[108511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327
Sep 25 18:52:37 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:38 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327" returned: 0 in 0.256s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e973f821-f8f7-4006-8437-851e3448d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569b4309-470d-4faf-8fb4-e53416f4a327', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847a88b8-84be-46f6-bf31-ddbb45059f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:38 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Volume volume-569b4309-470d-4faf-8fb4-e53416f4a327 (569b4309-470d-4faf-8fb4-e53416f4a327): created successfully
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847a88b8-84be-46f6-bf31-ddbb45059f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Flow 'volume_create_manager' (73a4d49c-0d91-4b8c-8b7e-574d7b7fdd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:38 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-f154711a-0f13-466e-972b-3abad68e9a27 tempest-ProjectMemberTests-502303593 None] Created volume successfully.
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Creating offline snapshot bba438db-c361-4526-b722-76a568d56677 of volume 569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689e893-ae45-46a8-86b0-d57fc2d1fa7d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:38 devstack sudo[108514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327
Sep 25 18:52:38 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:38 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327" returned: 0 in 0.371s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:38 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 1G {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:38 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 1G
Sep 25 18:52:38 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:39 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 1G" returned: 0 in 0.431s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569b4309-470d-4faf-8fb4-e53416f4a327 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:39 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569b4309-470d-4faf-8fb4-e53416f4a327 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677
Sep 25 18:52:39 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:39 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-569b4309-470d-4faf-8fb4-e53416f4a327 -F qcow2 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677" returned: 0 in 0.300s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:39 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 is being set with open permissions: ugo+rw
Sep 25 18:52:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:39 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677
Sep 25 18:52:39 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:39 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677" returned: 0 in 0.278s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:39 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:39 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info
Sep 25 18:52:39 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:40 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info" returned: 0 in 0.247s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:40 devstack cinder-volume[86534]: WARNING cinder.volume.drivers.remotefs [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info is being set with open permissions: ugo+rw
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:40 devstack sudo[108537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info
Sep 25 18:52:40 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:40 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.info" returned: 0 in 0.254s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:40 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-8917ca6f-9d36-4c68-8ad3-ba0fb2a67e0e tempest-ProjectMemberTests-502303593 None] Create snapshot completed successfully
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-bba438db-c361-4526-b722-76a568d56677-delete_snapshot" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Lock "cinder-bba438db-c361-4526-b722-76a568d56677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-569b4309-470d-4faf-8fb4-e53416f4a327" by "delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-569b4309-470d-4faf-8fb4-e53416f4a327" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-bba438db-c361-4526-b722-76a568d56677" by "_delete_snapshot" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-bba438db-c361-4526-b722-76a568d56677" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Deleting offline snapshot bba438db-c361-4526-b722-76a568d56677 of volume 569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] snapshot_file for this snap is: volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 {{(pid=86534) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fb07a9-a26f-435b-8e83-e2904341b817]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:40 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:40 devstack sudo[108546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677
Sep 25 18:52:40 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:41 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677" returned: 0 in 0.371s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-569b4309-470d-4faf-8fb4-e53416f4a327(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86534) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeaa3e3-bb9b-4f51-a646-1f808af6470b]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:41 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327
Sep 25 18:52:41 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:41 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327" returned: 0 in 0.379s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:41 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677
Sep 25 18:52:41 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:41 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677" returned: 0 in 0.366s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:41 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:41 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677
Sep 25 18:52:41 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (75562170-19f1-4005-85b4-7656b480e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:42 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667d812d-2f95-4256-bb2d-b0177a029a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327.bba438db-c361-4526-b722-76a568d56677" returned: 0 in 0.283s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-bba438db-c361-4526-b722-76a568d56677" released by "_delete_snapshot" :: held 1.502s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667d812d-2f95-4256-bb2d-b0177a029a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482686296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d981df9-db15-4a47-8424-cfffdcb41cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:42Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c9f217-0cb0-4bd9-a786-4ca4fe128b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c9f217-0cb0-4bd9-a786-4ca4fe128b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f86bb-58ed-4d2d-9bba-8336a41339bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f86bb-58ed-4d2d-9bba-8336a41339bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d981df9-db15-4a47-8424-cfffdcb41cc3', 'volume_name': 'volume-8d981df9-db15-4a47-8424-cfffdcb41cc3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f7c036-371d-4b7d-a6e9-f15df40f6d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f7c036-371d-4b7d-a6e9-f15df40f6d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39655ed9-1546-4a02-9840-ac4d490c9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:42 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Volume 8d981df9-db15-4a47-8424-cfffdcb41cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d981df9-db15-4a47-8424-cfffdcb41cc3', 'volume_size': 1}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482686296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d981df9-db15-4a47-8424-cfffdcb41cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:42Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Creating volume 8d981df9-db15-4a47-8424-cfffdcb41cc3 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:42 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-569b4309-470d-4faf-8fb4-e53416f4a327" released by "delete_snapshot" :: held 1.585s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:42 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 1073741824
Sep 25 18:52:42 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Created reservations ['4a414be6-b883-40da-a846-4b2b88a5bd80', 'ca8083f8-a4ac-4f5b-9cd5-1d84abf8e617', '1bbb24a8-cc77-4a24-8b99-d98dbaa6f225', '2bbd1d0a-0aaf-45fe-9b14-a5c94ca8daee'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:42 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Delete snapshot completed successfully.
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-fa5b1473-424c-4553-94c4-dbe39cfa65fb tempest-ProjectMemberTests-502303593 None] Lock "cinder-bba438db-c361-4526-b722-76a568d56677-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:42 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 1073741824" returned: 0 in 0.433s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:42 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3
Sep 25 18:52:42 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-569b4309-470d-4faf-8fb4-e53416f4a327-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Lock "cinder-569b4309-470d-4faf-8fb4-e53416f4a327-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Acquiring lock "cinder-quobyte-569b4309-470d-4faf-8fb4-e53416f4a327" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-569b4309-470d-4faf-8fb4-e53416f4a327" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aedf76-db10-4f74-a298-cea347ae303e]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:42 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3" returned: 0 in 0.253s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:42 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39655ed9-1546-4a02-9840-ac4d490c9f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d981df9-db15-4a47-8424-cfffdcb41cc3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b40df4-0ba8-41c4-9c16-014d869a4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:43 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Volume volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 (8d981df9-db15-4a47-8424-cfffdcb41cc3): created successfully
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b40df4-0ba8-41c4-9c16-014d869a4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (75562170-19f1-4005-85b4-7656b480e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:43 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-d209f7bc-28c7-4224-9642-73a0b9bceafd tempest-ProjectReaderTests-1584201177 None] Created volume successfully.
Sep 25 18:52:43 devstack sudo[108574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327
Sep 25 18:52:43 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-8d981df9-db15-4a47-8424-cfffdcb41cc3-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-8d981df9-db15-4a47-8424-cfffdcb41cc3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:43 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327" returned: 0 in 0.384s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:43 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327
Sep 25 18:52:43 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-quobyte-8d981df9-db15-4a47-8424-cfffdcb41cc3" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-8d981df9-db15-4a47-8424-cfffdcb41cc3" acquired by "delete_volume" :: waited 0.018s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f1d89d-f68a-43b2-944e-f4ee2a419f5d]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:43 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3
Sep 25 18:52:43 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:43 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-569b4309-470d-4faf-8fb4-e53416f4a327" returned: 0 in 0.261s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Lock "cinder-quobyte-569b4309-470d-4faf-8fb4-e53416f4a327" released by "delete_volume" :: held 0.717s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Created reservations ['df138406-1672-49c9-9112-3e19d922f0a5', '0234997f-2f6d-45cc-b9b2-2d0ed0b349f3', '9d652265-556c-44c8-8f97-6ae13308e0aa', '2e56aecf-d871-42ae-9b08-a0b6308ff95b'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:43 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:43 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:43 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3" returned: 0 in 0.410s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:43 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:43 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3
Sep 25 18:52:43 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:44 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Deleted volume successfully.
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-6abb8bff-2161-4a1b-b916-cc9affbac1a9 tempest-ProjectMemberTests-502303593 None] Lock "cinder-569b4309-470d-4faf-8fb4-e53416f4a327-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:44 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-8d981df9-db15-4a47-8424-cfffdcb41cc3" returned: 0 in 0.262s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-8d981df9-db15-4a47-8424-cfffdcb41cc3" released by "delete_volume" :: held 0.715s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Created reservations ['fc5d0eb3-8d7c-4d51-b165-34949976e31f', '8fcba09e-7edc-42d3-b7ff-b9cdf6bd5939', '289e757d-610b-4c15-8e46-2d8c1b64bd76', '5e29609d-97de-4497-adcd-598cd9021c7d'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:44 devstack sudo[108594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:44 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:44 devstack sudo[108596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:44 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:44 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.280s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:44 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Deleted volume successfully.
Sep 25 18:52:44 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.269s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG oslo_service.periodic_task [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] Running periodic task VolumeManager._thread_info {{(pid=86534) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread count: 28 {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-3a02d622-5a05-44bb-8e43-50fd28676e3c None None] thread info: [<_MainThread(MainThread, started 136458615922816)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136458502600448)>, <Thread(Thread-3 (stat_writer), started daemon 136458502672832)>, <Thread(Rabbit-heartbeat, started daemon 136458501589760)>, <Thread(Thread-5 (_runner), started daemon 136458499732160)>, <Thread(Thread-7 (_runner), started daemon 136458499800704)>, <Thread(fd_logger, started daemon 136458497284032)>, <Thread(privsep_reader, started daemon 136458495660736)>, <Thread(tpool_thread_0, started daemon 136458488968896)>, <Thread(tpool_thread_1, started daemon 136458480576192)>, <Thread(tpool_thread_2, started daemon 136458472183488)>, <Thread(tpool_thread_3, started daemon 136458463790784)>, <Thread(tpool_thread_4, started daemon 136458455398080)>, <Thread(tpool_thread_5, started daemon 136458447005376)>, <Thread(tpool_thread_6, started daemon 136458438612672)>, <Thread(tpool_thread_7, started daemon 136458430203584)>, <Thread(tpool_thread_8, started daemon 136458421794496)>, <Thread(tpool_thread_9, started daemon 136458413385408)>, <Thread(tpool_thread_10, started daemon 136458404976320)>, <Thread(tpool_thread_11, started daemon 136458396567232)>, <Thread(tpool_thread_12, started daemon 136458388158144)>, <Thread(tpool_thread_13, started daemon 136458379749056)>, <Thread(tpool_thread_14, started daemon 136458371339968)>, <Thread(tpool_thread_15, started daemon 136458362930880)>, <Thread(tpool_thread_16, started daemon 136458354521792)>, <Thread(tpool_thread_17, started daemon 136458346112704)>, <Thread(tpool_thread_18, started daemon 136458337703616)>, <Thread(tpool_thread_19, started daemon 136458329294528)>] {{(pid=86534) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 25 18:52:44 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e03e703a-3503-43c8-9506-90b36feda982 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-8d981df9-db15-4a47-8424-cfffdcb41cc3-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (d16251da-8bb3-4937-bdf2-1de3cba2b844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62a3a51-7312-4a10-b9fb-617fdabdb5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62a3a51-7312-4a10-b9fb-617fdabdb5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587043265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e6cd61-5959-4d84-9adf-d1a150f846a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:45Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73166fda-f1b0-4e1d-9119-b597746cf77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73166fda-f1b0-4e1d-9119-b597746cf77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19acb72-07a7-4d35-b501-d42038003eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19acb72-07a7-4d35-b501-d42038003eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e6cd61-5959-4d84-9adf-d1a150f846a3', 'volume_name': 'volume-88e6cd61-5959-4d84-9adf-d1a150f846a3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aaa827b-6406-4dbb-9ac1-87d1794ac4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aaa827b-6406-4dbb-9ac1-87d1794ac4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647f6da6-0673-452b-a053-cef38dbb43a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:45 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Volume 88e6cd61-5959-4d84-9adf-d1a150f846a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e6cd61-5959-4d84-9adf-d1a150f846a3', 'volume_size': 1}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587043265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e6cd61-5959-4d84-9adf-d1a150f846a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:45Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Creating volume 88e6cd61-5959-4d84-9adf-d1a150f846a3 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:45 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:45 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 1073741824
Sep 25 18:52:45 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:45 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 1073741824" returned: 0 in 0.520s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:45 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3
Sep 25 18:52:45 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:45 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3" returned: 0 in 0.255s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647f6da6-0673-452b-a053-cef38dbb43a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e6cd61-5959-4d84-9adf-d1a150f846a3', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:45 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68935e6e-cac2-4343-b5d9-db9c17246527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:46 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Volume volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 (88e6cd61-5959-4d84-9adf-d1a150f846a3): created successfully
Sep 25 18:52:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68935e6e-cac2-4343-b5d9-db9c17246527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:46 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (d16251da-8bb3-4937-bdf2-1de3cba2b844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:46 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-b65b945d-7eaf-43fb-983a-14693a696667 tempest-ProjectReaderTests-1584201177 None] Created volume successfully.
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-88e6cd61-5959-4d84-9adf-d1a150f846a3-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-88e6cd61-5959-4d84-9adf-d1a150f846a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-quobyte-88e6cd61-5959-4d84-9adf-d1a150f846a3" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-88e6cd61-5959-4d84-9adf-d1a150f846a3" acquired by "delete_volume" :: waited 0.016s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c02f09-545f-4539-acb2-9d35d0d6b92c]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:47 devstack sudo[108610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3
Sep 25 18:52:47 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:47 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3" returned: 0 in 0.417s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:47 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3
Sep 25 18:52:47 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:47 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-88e6cd61-5959-4d84-9adf-d1a150f846a3" returned: 0 in 0.243s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-88e6cd61-5959-4d84-9adf-d1a150f846a3" released by "delete_volume" :: held 0.705s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:47 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Created reservations ['f0fb3b2b-b43d-4383-afab-a541c8bc7143', 'ff6aa7a6-4e5a-4157-bb08-2ae2e1ae17b7', 'abb148bd-840d-4950-adc2-ae893bb60247', '0dd474c6-aa56-4177-a31c-3c8cb2e1db58'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:48 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:48 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:48 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.268s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:48 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Deleted volume successfully.
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-03052cd7-8d5e-41b6-8fa5-ccf13a5cd2b6 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-88e6cd61-5959-4d84-9adf-d1a150f846a3-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (af5d97b3-870d-48d9-a6f0-3cf62a683bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c073f3-ab58-4dbb-9430-4461a7a00121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c073f3-ab58-4dbb-9430-4461a7a00121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273863248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509b2781-ad7b-48cd-9a61-762f14e00fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:49Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec6b28b-29e5-433f-8b0c-34e1e082f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec6b28b-29e5-433f-8b0c-34e1e082f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1b6c11-6191-45cb-b107-2c546871c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1b6c11-6191-45cb-b107-2c546871c247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509b2781-ad7b-48cd-9a61-762f14e00fdf', 'volume_name': 'volume-509b2781-ad7b-48cd-9a61-762f14e00fdf', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6613a83f-d9cc-43cb-a809-d36da065ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6613a83f-d9cc-43cb-a809-d36da065ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afa1430-db93-416b-86ff-43bf15a7bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:48 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Volume 509b2781-ad7b-48cd-9a61-762f14e00fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509b2781-ad7b-48cd-9a61-762f14e00fdf', 'volume_size': 1}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273863248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509b2781-ad7b-48cd-9a61-762f14e00fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:49Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Creating volume 509b2781-ad7b-48cd-9a61-762f14e00fdf {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:48 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:48 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:48 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf 1073741824
Sep 25 18:52:48 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:49 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf 1073741824" returned: 0 in 0.483s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:49 devstack sudo[108627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf
Sep 25 18:52:49 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:49 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf" returned: 0 in 0.249s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afa1430-db93-416b-86ff-43bf15a7bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509b2781-ad7b-48cd-9a61-762f14e00fdf', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70eb039-6aaf-4a68-a47d-26cd527083c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:49 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Volume volume-509b2781-ad7b-48cd-9a61-762f14e00fdf (509b2781-ad7b-48cd-9a61-762f14e00fdf): created successfully
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70eb039-6aaf-4a68-a47d-26cd527083c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:49 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (af5d97b3-870d-48d9-a6f0-3cf62a683bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:49 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-6dd6bd51-1d0c-4c8f-adbe-1bfb815148c1 tempest-ProjectReaderTests-1584201177 None] Created volume successfully.
Sep 25 18:52:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-509b2781-ad7b-48cd-9a61-762f14e00fdf-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-509b2781-ad7b-48cd-9a61-762f14e00fdf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-quobyte-509b2781-ad7b-48cd-9a61-762f14e00fdf" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:50 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-509b2781-ad7b-48cd-9a61-762f14e00fdf" acquired by "delete_volume" :: waited 0.017s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:50 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d6f29b-92fd-42f6-96da-bf868c8fb9dc]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:50 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:51 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf
Sep 25 18:52:51 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:51 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf" returned: 0 in 0.378s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:51 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf
Sep 25 18:52:51 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:51 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-509b2781-ad7b-48cd-9a61-762f14e00fdf" returned: 0 in 0.246s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-509b2781-ad7b-48cd-9a61-762f14e00fdf" released by "delete_volume" :: held 0.670s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Created reservations ['69b52dea-f8bb-4dcf-b900-9899b314c7c8', '9e117d65-43a2-4f27-b29c-4f48614ef58a', '52b6dbf7-1ba0-4967-a136-b0d45410c0a0', 'd721e422-9b97-4065-a987-d7991414d683'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:51 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:51 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:51 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:52 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.251s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:52 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Deleted volume successfully.
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-746b6453-e2f7-45b9-920f-69b0824e1a95 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-509b2781-ad7b-48cd-9a61-762f14e00fdf-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86534) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (7782a075-4502-46f7-bd14-1cba8e771511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaca1db-5248-4387-89be-a66e495a228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaca1db-5248-4387-89be-a66e495a228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633453876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706d19aa-bef6-4ffa-9402-ca3f724267e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:52Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f64d36e-c020-4880-8928-333a635f04b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f64d36e-c020-4880-8928-333a635f04b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4751ed75-2b9b-4cca-a908-9604590afea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4751ed75-2b9b-4cca-a908-9604590afea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706d19aa-bef6-4ffa-9402-ca3f724267e8', 'volume_name': 'volume-706d19aa-bef6-4ffa-9402-ca3f724267e8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751eb934-5bde-4b7a-bca1-1c4272a7056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751eb934-5bde-4b7a-bca1-1c4272a7056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6a1fc3-a04f-4961-8a93-95d71cac4b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:52 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Volume 706d19aa-bef6-4ffa-9402-ca3f724267e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706d19aa-bef6-4ffa-9402-ca3f724267e8', 'volume_size': 1}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7c1bb88a9760>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-25T16:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633453876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706d19aa-bef6-4ffa-9402-ca3f724267e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d15c688181498e9a7fc7793d5fd945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T16:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T16:52:52Z,use_quota=True,user_id='ea3f042491974d17b3bab0493871736d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(723aae03-2fee-41cb-b117-c06d6077802d),volume_type_id=723aae03-2fee-41cb-b117-c06d6077802d)}" {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.remotefs [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Creating volume 706d19aa-bef6-4ffa-9402-ca3f724267e8 {{(pid=86534) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Selected osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2 as target Quobyte volume. {{(pid=86534) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 25 18:52:52 devstack cinder-volume[86534]: INFO cinder.volume.drivers.remotefs [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] casted to osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2
Sep 25 18:52:52 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 1073741824 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:52 devstack sudo[108642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 1073741824
Sep 25 18:52:52 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:53 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 1073741824" returned: 0 in 0.448s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:53 devstack sudo[108649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8
Sep 25 18:52:53 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:53 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8" returned: 0 in 0.265s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'} {{(pid=86534) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6a1fc3-a04f-4961-8a93-95d71cac4b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706d19aa-bef6-4ffa-9402-ca3f724267e8', 'volume_size': 1}' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476c0cc0-4e77-486a-b97c-f191ad5893d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 25 18:52:53 devstack cinder-volume[86534]: INFO cinder.volume.flows.manager.create_volume [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Volume volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 (706d19aa-bef6-4ffa-9402-ca3f724267e8): created successfully
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476c0cc0-4e77-486a-b97c-f191ad5893d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86534) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Flow 'volume_create_manager' (7782a075-4502-46f7-bd14-1cba8e771511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86534) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 25 18:52:53 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-cc68604d-98bc-4f77-afb6-ee9d71187af8 tempest-ProjectReaderTests-1584201177 None] Created volume successfully.
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-706d19aa-bef6-4ffa-9402-ca3f724267e8-delete_volume" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-706d19aa-bef6-4ffa-9402-ca3f724267e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "cinder-quobyte-706d19aa-bef6-4ffa-9402-ca3f724267e8" by "delete_volume" {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-706d19aa-bef6-4ffa-9402-ca3f724267e8" acquired by "delete_volume" :: waited 0.026s {{(pid=86534) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG oslo.privsep.daemon [-] privsep: reply[9115326a-5b0f-430a-a491-d9b3173b495a]: (4, 'qcow2') {{(pid=88488) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 25 18:52:53 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:53 devstack sudo[108652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8
Sep 25 18:52:53 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:54 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8" returned: 0 in 0.386s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:54 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8
Sep 25 18:52:54 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:54 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3/volume-706d19aa-bef6-4ffa-9402-ca3f724267e8" returned: 0 in 0.266s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-quobyte-706d19aa-bef6-4ffa-9402-ca3f724267e8" released by "delete_volume" :: held 0.708s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG cinder.quota [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Created reservations ['5ccc701e-0d6a-4746-9298-16627791fce8', 'dfb7977d-b5e2-4040-95be-7042d2ce5cc9', '637d7f29-36a3-4d50-96b8-e5082736d329', '5e06bebd-588a-4bfe-a53b-80f76a12bd41'] {{(pid=86534) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2': None} {{(pid=86534) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG cinder.volume.drivers.quobyte [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9134aa39-1a14-4ed6-9c12-e2e2f5b0e2d2'] {{(pid=86534) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.lockutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86534) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3 {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 25 18:52:54 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3
Sep 25 18:52:54 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 25 18:52:54 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG oslo_concurrency.processutils [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e06a9f2fd817f4ee80714c745f19fb3" returned: 0 in 0.260s {{(pid=86534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG cinder.manager [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Notifying Schedulers of capabilities ... {{(pid=86534) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 25 18:52:54 devstack cinder-volume[86534]: INFO cinder.volume.manager [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Deleted volume successfully.
Sep 25 18:52:54 devstack cinder-volume[86534]: DEBUG cinder.coordination [None req-e5c4a09a-b971-44d0-84a7-fd282ff2da84 tempest-ProjectReaderTests-1584201177 None] Lock "cinder-706d19aa-bef6-4ffa-9402-ca3f724267e8-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=86534) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 25 18:53:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:UPDATE=83,cinder:SELECT=58,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 25 18:53:14 devstack cinder-volume[86534]: DEBUG dbcounter [-] [86534] Writing DB stats cinder:SELECT=54,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=20 {{(pid=86534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}